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CHAPTER 1 ; INTRODUCTION TO THE STUDY 



Bjair Rudes and Paul Hops took 



A. Background 



In recognition of the special educational needs of American Indians and Aiasica 
Natives, the Indian Education Act (P.L, 92-318, Title IV) became law on June 
23, 1972, The Part A Program represents that part of the Indian Education Act 
providing e n 1 1 1 Temen tenants to public school districts enrolling African 
Indian and Alaska Native students. The number of school districts 
^participating has Increased from 435 in fiscal year 1973 to more than 1,000 In 
fiscal year 1983* The percentage of Indian children residing in school 
districts* served by Part A grants has grown from 59 percent in 1973 to 
approximately 85 percent in 1983.* * . ' ■ 



ft 



In September of 1980, Development Associates, Inc., wa^ awarded a contract 
through the U, 3* Department of Education to evaluate the operation and" 
effectiveness of the Title IV, Part A Program, The study was conducted under 
the authority of the Secretary as provided for in Section 417 of the General* 
Education Provision Act - (20 USC 1226C), It represented the first 
comprehensive evaluation of the program since . its. inception, and was in * 
response to requests from the Senate Interior Committee for systematic 
Information concerning" Part A Program operations. Impacts* and costs, The 
House Interior Subcommittee and the House Education and Labor Subcommittee 
have also frequently requested similar information. 



To accomplish the study 1 s purpose, data were collected during fall and spring 
visits In 1981^82 to 115 Part A projects. These projects were a siratif led 
random sampl/ of all Part A projects In public school districts which had been 
operating three or more years and with 30 or more American Indian/Alaska 
Native students In 1981 (I.e., 8536 of 'the Part A projects in public schools), 
data were collected from th4jFo,llo>r1ng r groups of '] respondent*'* (a) loealv school, 
administrators, (bf projec^^^^ 

committee members, (e) public, .school principals, (f) teachers, ,(g) leaders 1n 




ERIC 



1-2 



students completed self -administered questionnaires; other respondents were 
interviewed. In addition, data were gathered from project and local education 
agency (LEA) files. A total of 19, data collection instruments was used in the 
study, The objectives of the study were to describe the range of Part A 
projects, ftverraine the nature and extent of Part A Program impacts, and tq. 
Identify and examine potential legislative and regdlatory changes that might 
help achieve>the goal of meetlng^the educational needs of American Indian 
children. More specifically, the study was designed to address eight -major 
research questions, They were as follows r ■ . 

t What are the organizational , fiscal, and human resources available to Part A 

projects, and how do projects utilize these resources? " * / 

« To what extent do the objectives of projects funded under the Part A 
Entitlement Program address the special educational and/or culturally 
related academic needs of American Indiaa/Alasfca Native children? 

• How have Part A project activities been Implemented? . 

t Wh^t are the impacts of Part A projects on American Indian/Alaska Native 
studeHW?^ " 

• What impacts do Part A projects have on the parents of American 
Indian/Alaska Native children and on. the American Indian/Alaska Native 
communities that projects serve? * . 

• What Impacts do Part A projects have upon their LEAs? . ■ *• 

• Hov^do federal'Hvel activities, especially those of the Office of Indian 
Programs, affect Part A projects? 

• What is the total amount of federal education funds expended by local school 
districts on Indian students In grades K-J2 and how many of these students 
are receiving various types of special services? 

The overall results of the study are reported on In the study's Final Report 
and companion volumes. In the Final Report, as well, are presented a brief 
description ttf the history of Indian education In the U.S.., the his^qry of the 
Title IV, Part A Program, and the theoretical and methodological framework 
within which the?, evaluation was conducted. 



• ' V--5 



B. Purpose and Content of this Monograph \/ ^ Q *%•"* 
gur.'A.. provide a mechanism Lfa&Hipt!^ 
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attendance of Indian students. Congressional reviewers of the Title IV* Part 
A Program have consistantly sought information 1 on the impact of the Program on 
student achievement and attendant. Gathering and analyzing information on - 
student achievement and attendance Ahus became major focuses of the 
Development Associates evaluation, * 

This monograph provides a detailed descrlpton of the data whfch were collected 
concerning student achievement and attendance* As will he noted, a number of 
parallel measures af achievement and attendance were col 4«teti7 and the 
monograph thus attempts to Integrate Information from diverse sources. It was 
our belief that on issues as complex as achievement and attendances multiple 
data* sources were highly desirable* ^ 

The monograph consists of three major parts. In Part A, we present the 
detailed analyses of information on academic achievement. Part A Includes 
separate sections on analyses of previously existing data, cross-sectional 
analyses oft test scores, indicators of student achievement reported by project 
personnel , ratings of gains by parents, teachers, and staffs, tutor ratings of 
the effectiveness of tutorial programs, and ratings by students of their 
academic gains. Part B describes the results on /-school attendance and , 
retention. Part 8 includes data collected from school records, project 
staffs, principals, teachers, parents; and students. Part C presents data on 
knowledge and -expectations for post-secondary education by Indian students. 
Also, in Part C, data concerning the post-secondary experiences of Indian 
students are presented, » ^ 

Conceptual and Methodological Issues Relating to Measures of Student 
Achievement 9 ; 

During the design phase of the evaluC^m, consideration was given to a 
variety of different approaches to assessing the Impact of Title IV, Part A 
projects on student academic achievement. In reviewing the experience of 
evaluation researchers, it was found that each approach posed certain 
difficulties for this evaluation. The most eodiram^type of evidence used by 
evaluators in assessing academic achievement consists of the results of 
standardised achievement test scores. These, however^postd the following 
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t Such tests do not necessarily test students on what they have been taught 
(they are not normed to a given curriculum); 

a ■ ■ ' - ; 

» Such tests may contain hidden bias, either in wording or format, against 
various subpopu'atlons being tested; since, for this. evaluation, test scores 
of students from a large number of different cultural, linguistic, regional t - 
ana" economic backgrounds were to be compared, hidden test bias could oe a 
problem. . , " j 

• Different states, districts, and, in some cases, 1 individual schools ma/ use 
different standardized achievement tests; while there exist various I . 
approaches to equating results across different tests so that. they art 
comparable, each approach has Its weakness, and not all standardized/tests 
are amenable to these approaches. | *, 

t Different states "and school districts may administer achievement tests to 
students afcMMfferent grade levels and at different times of the school 
year; where such differences exist, cKoss-site comparison is extremely 
difficult. . » 

Another type of evidence w'hich is widely used In assessing the Impact of" 
educational programs on student achievement dons Ists of ■student class grades. • 
Again, however, there are a number of problems for a nationwide evaluation, ^ 



• Different school districts use different systems for reporting grades 

. (letter grades, grade point equivalences, etc.); while approaches exist for 
standardizing these different systems, each has weaknesses not unlike those 

• noted above. - 

• Grades are considered to be more subject ive^evldence than test scores, since 
factors such as teacher judgment and school policy enter ioto the awarding 
of grades. • , % # — « 

• Data on student grades are more difficult t^aeeesfcthan are data on ■ 
achievement test results. Student grade data may Hot be recorded on central 
school or district files until the end of a semester, thus cellee-ting this 
data In mid-semester entalts requesting it from each teach^r^And the 
grades which the teacher has during mid-semester may not be Tomcat ive 
(averaged) at that point. In any case, schools and teachers tend to 
maintain confidentiality of students' grades more strenuously than 
confidentiality of. test score results. , . 

'. - % 

Other types of evidence which have been used to a greater or lesser extent in 
evaluating the effects, of educational programs on student academic achievement 
Include ratings of students by teachers, parents, and LEAs staffs, and 
anecdotal data on student accomplishments as* a* result of participation in a ^ 
project. : '>;-, : ,, ■ ' ' . . *' 
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The advantage of both of these types of evidence is that the data are more 
easily collected (there is no conflict of confidentiality involved),- the 
assessments can be more directly attributed to project effects Han is the 
case with standardized test score results, -and this type of data can reveal 
gains in areas not normally assessed by standardized tests or class- grades • 
(e.g. classroom participation, study habits). The weakness of this type. of 
evidence Is that it fs highly subjective, and, in the case of anecdotal 
evidence, relatively unsystematic. 

ms outlined above, each of the various types of evidence which could be- used 
In assessing the Impact of- educational programs on student achievement 
provided a different perspective on the phenomena and posed certain drawoacks 
- particularly for an evaluation which Is national In scope. In formulating 
the final design f or *<the evaluation of the Title IV, Part A Program, it was 
decided to capitalize on the different perspectives provided by these types of 
evidence to" the greatest extent possible, and in the process, hopefully, to 
minimize the drawbacks which each has when used Independently;: Thus, the 
study was designed to collect and analyze data from: .results of standardized 
achievement tests; anecdotal evidence provided by parents, project staff 
members, and others; ratings of project related academic gains by parents, 
project staff members, and- others; ratings of project related academ1<Pga1ns 
by parents, teachers, and LEft staffs; tutor/ratings of tutored students; and 
•student ratings of .assistance provided -by projects. Data were not collected 
on student grades because of the diff iculties entail-ed in collecting such data 
uniformly across sites. , / ' 

* / • i «•. 

Each of these types of evidence has been/analyzed independently, and is 
reported on in Chapters 3 through 8. In addition, the data have been analyzed 
collectively. In a sense to "triangulate" in on project effects oh student 
achievement. A summary of all of the* data 1s presented In Chapter 9. ; 

v.- 'i " ■ ' ■ ■ - 
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p.. Conceptual and Methodological -Issues Relating to Measures of Student Attendance 

School and district attendance figures are generally taken to be the primary 
source of data in assessing student attendance* In the Development Associate^ 
evaluation, data on attendance of Indian students were collected whenever 
possible over a five-school-year period* An analysis of these data is 
reported tn Chapter 10. .There were a number of difficulties associated with 
the use of such data* however 1 Among these were: 
' , \ ^ . • " 

• The absence of Individual student attendance data, because in certain 
districts only data on average dally attendance for preselected days were 
collected; - 

• The difficulty of collecting longitudinal data on students who move from one 
school to another; 

• The failure to compensate for late admission and/or transfer with in' 
semester in computing students' average dally attendance; 

t.The failure to distinguish consistently between absences and tardies; and 

% The failure of attendance figures to distinguish between absences due to 
natural causes (weather* medical, etc.) versus truancy, _ 

In addition* the number of days In p the school year' varied. somewhat among — ~. 
school districts, In particular where a teachers' strike, adverse, weather 
conditions, or other factors forced- the entire school to be closed for a 
period of time. This, -1n turn, made cross-site comparison of attendance 
fllgures problematic, , 1 

In order to provide a more complete picture of student attendance patterns, 
therefore, the Development Associates evaluation was designed to gather 
ratings by parents, teachers, principals, "and other school staff members , 
^regard.ing student attendance, and effects of the Title IV, Part A projects on 
encouraging more frequent attendance, This, together with other qualitative 
information, was collected to .help differentiate among the various causes of , 
absences, and to more directly assess project effects on improving, 
attendance. This information 1s, reported fn Chapter 11, in Part B. 
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In addition to the Information on student attendance* data were collected from 
a variety of sources on changes in the rate of student dropout and school 
completion. The results of the analyses of this material is provided in 
Chapter 13, in Part B. % 

Information on the knowledge of post secondary options and the post high 
school educational and employment activities of- samples of Indian high school 
students are presented in Part C as a supplement to the academic achievement 
and attendance data, presented in- this report. 



PART A: ACADEMIC PERFORMANCE IN PUBLIC SCHOOLS 



The purpose of the Title IV, Part A Indian Education Program as defined In 'the 
legislation is to meet the "culturally related academic needs" of Indian 
students* Most (SOX) Title IV, Part A projects ha^e formed academic or tutorial 
components to meet the culturally related academfc needs of Ind ian ^students, but 
other" components as well are designed to meet those ascademtc needs (cultural 
programs, counseling, home-school coordination, etcr)* * 

#= * 
In this part of the monograph, the results of the Development Associates 

evaluation of the Title IV, Part A Program relevant to academic performance are 

presented* As discussed in Chapter 1 , there is no single measure of academic 

pesrformance which is without weaknesses, so information was collected from a 

variety of sources concerning this topic, ? 

Chater 2 presents a meta-analysis on achievement test scores in which the results 
^froc^the Development Associates evaluation are integrated with previously 
existing studies* Chapter 3 provides £ description of the formal academic 
activities being conducted by projects* including the types of tutoring being 
performed, characteristics of tutors, and characteristics of Indian students 
receiving tutoring, Chapter 4 presents a detailed analysis of 1981 achievement 
test scores of Indian students at Part A projects and relates those scores to 
project activities, # 



Chapteiis 5 through 8 prlreent the rating by various types of Respondents of the - f - 
Impact of Part A projects on student academic achievement. Chapter S describes 
information provided by key project staff members (ijslfally project directors) to j, 
document the academic impact of their projects. Chapter 6 presents ratings by % . < 
> Part A project tutors of the academic gains experienced by their students* 
'Chapter 7 provides -information on the ratings given by parents of Indian -■• j 

students, regular^ classroom teachers, and Part A staff of th^ impact of projects f 
on math and language arts performance and student grades. Flnaljly, in Chapter 8, 
ratings by students of the helpfulness of the projects in the ar*eas of math and ^ 
reading are presented, * *; 

\. '■ 4 25 .. ' . •• hi 

:r ;£ summary of finding? and a statement of conclusions concerning academic ; 
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CHAPTER 2: 11 ENDS IN ACADEMIC. ACHIEVEMENT AMONG. INDIAN 
STUDENTS IN PUBCIC SCHOOLS . 

i •■ 

. Harry Day 



A. Introduction 



This chapter Is a review of the existing research literature concerning levels, 
of academic achievement among Indian Students prior to the enactment of the 
Title IV, Part A Indian Education Program, compared with subsequent levels of 
achievement. A primary purpose of the Part A Program has been to address "the 
special educational and ■culturally related academic needs" of Indian . 
children. Since the Title IV Program has been the national-level intervention 
of the 1970s most likely to affect the academic performance of Indian public 
school students, the Improvement in Indian student performance, \as reported In 
existing research data, should constitute an indication of progrUm impact, . 
More directly, these findings reflect the academic status of Indian students, 
both at the time of the Act andat present, and provide an indication of 
current academic needs. . - ■ 

Previous reports Issued by the Federal government, notably the Mepriam Report 
(1929) and the "Kennedy Report" (1969), highlighted the poor con^tjps unll? 
which Indian students were educated and, consequently, the low levels of 
academic skills developed. Prominent among tlie evidence cited were low scores 
on standardized achievement tests. 

* ■ * * * 

The cultural biases Inherent in academic achievement tests, intelligence 
tests, and other assessments of intellectual aptitude are well known and Tieed 
not be discussed In detail. 1 The thrust of the criticism of* these , 
measurements is that they underestimate the Intellectual ability of th^- 
minority-Student, and provide a poor assessment of his ability to functSoTTMn 
the real world. Their biases notwlthstandi rig, achievement* test scores provide 
relevant Infojnat ion regarding academic needs and their changes over time. ; 



I See the October 1961 Issue of the American Psychol ogl-st for detailed j, 
^discissions of these and related 1ssu.es. , \: 
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Thus, trie specif 1c purpose of this review Is to establish the relative levels 

of academic achievement :and trends among Indian students, as reflected by the 

2 

reported standardized achievement test results, of four time periods: r| 

• The 1950s — prior to any large-scale federal programs likely to benefit 4 
Indian students in public schools; 

* • The 1960s -r prior to and at the start of federal aid programs, such as 
ESEA Title I* which potentially benefitted public school districts with 
Indian enrollment; . ^ 

" • The 1970s prior to and at the start *of the Title IV* Part A Program, 
which provided funds to school districts for special academic and relat^L 
activities for Indian students, supplementing the special programs- begun a 
in the early to late 1960s; and a 

c The 1980s — when the Part A Program could be expected to have achieved 
Its greatest Impact to date* ' ¥ 

The focus here is mainly on Indian students attending public schools, where 
Part A funds are primarily directed,, 
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B s . Choice of Approach * 9 

In this review, available standardized achievement test results in reading and 
mathematics have been analyzed through the use of recently developed 
%eta-an^ lysis" techniques (Glass, 1976, 1978)% % Reading and mathematics 
scores were selected because they represent basic academic skills necessary 
for most academic courses and careers, A meta-analysis approach was used to 

: reduce the author -bias inherent In traditional research literature reviews, _ 
The approach is explicit; systematic, and replicable in Its methodology: other 

i researchers should attain like findings, although interpretations may vary, 

■ - ■ • *' 

*..,=' . , . *j 

A meta-analysis approach Involves the application of a standard procedure to 
the results from, a variety of sources, to translate these to a common standard 
and thereby render them directly comparable. When study sample sizes are ; 

\ small, resulting In relatively; low statistical power, tatters less likelihood 
of detecting a true difference in statistical tests for a trea^Jn<effeet. 

. "i ■ * . * ' ■ * " • ■ ' , V v "" ■ 

>' ■• ■ ; ' , ' , 27 /. ' ; ,);■; 

2 It was hoped to obtain sufficient data to analyze early versus late 1960s ^ |: 
and early versus late 1970s, but such were not available. ' 
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The "box score" procedure of tallying statistically significant findings 
across studies exacerbates this problem, and may fall to detect effects when 
sample sizes or treatment effects (or both) are small (Hedges and Olkln* 1980, 
as cited in £1 aeon la and Hedges* 1982), A meta-analysis approach determines 
an "effect size" for each study or set of findings, as a measure of the 
strength of the treatment effect* These are calculated by converting diverse 
scores or measures, such as grade equivalents, raw scores, and percentile 
ranks, to differences between treatment and comparison group means expressed 
in standard score units; the differences between groups thereby represent some 
proportion of a standard deviation, and can be contrasted directly. 

Furthermore, the conversion of scores to an effect size eliminates problems 
Inherent In certain types, for example, differences among grade equivalent - 
scores usually widen .with increasing grade because these overstate the actual 
differences between two groups* The use of an effect size score based on the 
standard deviation, difference between the groups provides a more accurate 
picture of their relative differences, and therefore of the estimated 
magnitude the treatment effect. 

The meta-analysis approach developed by Glass (Smith and Glass, 1977) was 
deemed most appropriate for this study, since the concern here -Is with the 
level of achievement of Indian students, not their statistical position 
relative to other samples. This approach also has the advantage of 
maximizing the amount of acceptable data. In addition to research reported In 
professional journals, the Glass method allows the Inclusion of data from 



3fhe formula used for calculating effect sizes is the following: 

7 E - T c 



where Xf-s ample mean of the experimental (Indian student) group, Xc-sample 
mean of the control (non-Indian student or all students) group,~S c -Standanl, „. 
deviation of the control group. 

^Unlike other approaches considered, such as Cooper and Rosenthal, 1980; 
Plllemer and Light, 1980; Light, 1980; Light and Smith, 1971; Cook and Gruder, . 
19781 Cohen at Si.. I 1982! Wlll&en and Putnam, 1982; Krathwohl, 1982; Hedges and 
Olkln, 1980; Si aeon 1a and Hedges, 1982. . - 
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dissertations, theses, and other sources w/iere the data are reported in * 
considerable detail, 

C. Sources of Achievement Data 

A comprehensive effort was made to identify all relevant research literature 
concerning academic achievement among Indian students since the 1950s, as well 
as to obtain achievement test scores directly from state and local education 
agencies. The following strategies were used to locate^ references and test 
data: 



t ERIC Search : A search using relevant descriptors was made of the ERIC 

system/ Over ninety articles were located and examined for possible use, 
.out of a much- larger set of articles related to Indian education, This 
source provided good coverage for the late 1960s and 1970s time periods* 

» Native American Research Information System (N Aft IS) : h search in the 
University of Oklahoma's new information system produced over 800 abstracts 
that were examined for relevance. This source was a useful supplement to 
ERIC, and. provided additional coverage, particularly for the 1970s, 



Indian Education Experts ; The Technical Advisory Panel to the H 
evaluation, as well as other knowledgeable individuals, suggested 
references and sources of data* Key among these were: the literature 
reviews conducted by the National Indian Education Association (1977), 
Berry (19B9)r"Havighurst (1970), the Kennedy Report and Senate Special 
Subconwrtttee on Indian Education Hearings (1969), and the Coleman Report 
(1966), Relevant references from the literature reviews and Congressional 
reports were located, and the Coleman Report findings were incorporated 
directly Into the analysis. These were the primary sources of information 
for the mid-1960s and earlier periods. 



• Surveys of State and Local Education Agencie^ 
— — " local school districts that reported 500 or 



^ _ s: Each of the 50 state 

education agencies and 

more Indian students were contacted, by telephone and main for 
achievement test data on Indian students and other cwiparison groups for 
the past several school years. This was a major effort, but yielded only 
twenty reports or data sources. Of these, there were only four 
potentially usable reports, of which only two had sample sizes sufficient 
and appropriate for presentation In this chapter. 5 "Host state agencies 
and school districts did not break down results by ethnic or racial groups 
or did not have a separate breakdown for Indian students; of those that . 
dtd* fnost contained insufficient data for analysis, this, source, provided 
late 1970s and early 1980s data* " ™ 5 



SOpe of the other two, Phoenix, was subsumed under the larger report for the 
State of Arizona, which was used* The other, Portland, involved veify smal 1 
numbers of Indian students in contrast to the Arizona ^ an d New Mexico 
ajitf was clearly atyp1ealr,iand thus was not combined with these other 
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» Results from the Study Sample : Achievement test results for the spring of 
1581 tor Indian students were sought from each of tfta US school districts 
included in the impact evaluation sample; Data were gathered/from 6,425 
students in 78 school districts. (Chapter 4 presents a cross-sectional 
analysis of these data.) This provides a robust source of 1980s data for 
comparison with the historical data from the 1950s, 1960s, and 1970s. 

From this extensive set of sources, almost 1,00 promising Studies were 
located and examined. Whenever possible, data from these studies were used 
by applying such techniques as: 

• The conversion of percentile scores to z-score equivalents, using normal 
curve conversion tables; ■ ' • . 

• The use of the standard deviation from the Indian student group, If the 
comparison group standard deviation was not available; and 

• The use of test norms "(mean scores of the sample on «£1c|rth« test was 
standardized) when a local comparison group, was not Included in istufly. 
Local comparison groups were typically used as a first choice. General ly, 
the local comparison groups comprised either •'whitest or the overall 
school district mean. 

Thus, every effort was made to retain any possible source of data. If only for 
one or two grades. However, of the studies examined,, only 16 proved to have 
usable data>-Jhe remainder were summaries of other works, were lacking In 
statistical detail, or were too flawed methodologically. The sources used are 
outlined in Table 2-1 . — /. 

Results- , • 

Tab le 2-2 presents the results of the meta-analysis using the Glass approach 
for four periods of time, with two separate samples for the 1980 period, as 
discussed above. The data are reported in terms of z-scores relative to the 
comparison samples (either local norms, national norms, or "whites," In that 
order when more than one .source of normative data were available). This table 
also provides an indication of the size of the Indian student sample for. each 
grade level for which data were available, and 1s summed across grade levels^ 
for each of the time period data sets, Data for every grade level were not 
regularly available for the time period data sets,. but aj least seven of the 
twelve grade levels (1-12) were covered In each set. There is thus a good 
basis for plotting the results across grade levels for all the data sets. 
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SOURCES USED IN THE" MCTA-AHALYSIS Of READING MP MATH ACiUIVQfi! TEST SCORfS 
OF AKEAICAH INDUS PUBLIC SCHOOL STUOQITS^ (960-1982) 



Data Sources: 



for 1950's 
•Cooifcs (1958) 



for 1960's 



966) 



in it; 



Albtrt (1971) 
Sanders (1972 



'I 



Jass (1971) 

Sliders (1972) 
glass (1971) 
Tafley (1975) 
son (1978) 



Ren Hex-loo Department of It (19IQ) 

Development Associates,' inc. (1983) 
Takdl S Hudd)estOR 



Pate of Data 



1951-54 



mm 1 

1969 ' 
1967-69 
1967-69 



1970 
1970' 

1970-71 
1976 
1976 
1978 



■4 



1981 
1981 
1980 



Nmter of Indians 



tending 



3,054 



5,500* 
1.882 

108 



51 



127 
>475 



51" 

SO- 

'60 

54 



3,962 
25,242 



495 



♦Estinattd, exact fasten not prsvldgd. 
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31 



nar 



. MM 



5,500* 
1,812 



£00 
0 



127 
435 

■0 
49 
0 
0 



mi 

m 



Grade Levels 



4-12 



6, 9, 12 
10-12 

1 ' 
1,6 

'. M 



' 6-12 



12 



4-5 
4,1 
9-12 
74 



5, a, 11 

1-12 

Mi 

10, 12 



Location/Sites 



Phoenix, Albuqi'irqui, Aberdeen, Hillings, 
AnadirkOt ftsiop 



Aberdeen, Juneau, Huskogeip Havatio, Mioenix 
School Districts ' 
feu Hexico, Arizona, Okiahon, Texas 
New York state 
Adair 



North Carolina 



Mix School Districts 



Detroit, Michigan 
South Dakota 



national 
national 



•v-.V. ■> ■ 



TABLE 2-2 

mm T«LE*OF mm m hathwtics achiev™ z-scores for mini STUBom ri srade 



. LEVEL MO TWE PERIOD 



> 



ACHl^OCHT TEST HPi AND TIKE PERIOD 



Reading 



,1950's Z-scores 
Nuqber of Indian! 

SjEQ'i Z-soeris 
, liber of Indians 
ITO's Z-icom 
Hater of Indians 
1980's (Sample) Z-seorts 

Mir of Indians * 
1960*S (A2 and IK) Z-seerts 
NunbiF of Indians 



fethnsaties 1950's Z-scores 
Nunber of 
• liM's Z-iMrii 



s 

1970's Z-scores 

M&r of Indians . 
iSBO's {Sanple} Z-scorts 

Nnoer of Indians 
1960's (AZ and Mi) Z-scorts 

Number of Indians 



1 


1 


3 


4 


5 


5 


7 


I 


9 


10 


11 


12 


Total 
Indians 












J 


















• 


- 


.,24 


.,40 


•,36 


-.35 


-.22 


-,38 


-,25 


-.59 


-.50 
130 






- 




480 


443 


435 


471 


,349 


111 


, 246 


180 


3,064 




.,72 




* . 


• 


-J 


- 




'..64 


-.90 


-1.17 


.1,08 




159 


51 


391 


■ 




A A£A , 

2,260* 






A AAA^ 

2,000* 


AAA 

80? 


190 


2,485* 


a *ij aa 

8,743* 








-1,08 


-1.21 


*r.i7 


AM 




.1,70 


.1,36 


-1.13 


•1.49 




■ 






12 


ii 


43 


48 


54 


34 


26 


261 


214 


813 






-.21 


>.2i 


•.il 


.,36 


..38 


-.34 


-.34 


-.57 


..55 


■ 




ft 


- 


191 


us 


841 


831 


892 


m 


m 


464 


m 




6,341 


..50 


..61 


-.77 




..60 


-ill 


.,58 


.,60 


-.51 


..64 


-.72 


-.57 




1,171 


1,141 


2,135 


2.1B 
a 


3,356 


2,102 


2,290 


3,740 


2,468 


1,967 


3,063 


1,584 


29,204 


- 


- 


s 


.,21 


-.31 


..46 


.,42 


.,34 


-.47 


.,43 




-.45 




- 


B 


B 


480 


443 


435 


47) 


349 


316 


246 


159 


330 


.3,029 


.,81 


S 


-1,54 


m 


a 


.1:40 






.,67 


-L05 


.1.02 


.,81 






' ' / 

• •/ 


340 


m 


■ 


2,260* 




■ 


2,000* 


807 




2,485* 


ft CftAi 

8,190* 




J £ 




.,70 


■ 


.1,00 


-1,07 


4,14 


.1,04 


-1,30 


•iB 


.1.04 










30 




43 


24 


24 


12 


14 




193 


194 


■ 




-.25 


-.27 




-.39 


■•39 


.,17 


.,42 


-.4> 


"it 








■ 




sss 


848 


829 


893 


167 


497 


464 






6,340 * 


-.21" 


-.50 


-.67 


-.52 


.,44 


.,47 


-.36 


..48 


-.47 


.,47 


-.95 


..§0 




2,171 


,2,110 


2,151 


2,184 


3,349 


2,083 


2,262 


3,726 


2,461 


1,975 


3,033 


1,576 


29,081 



•Includes estiaates for cfteian study (1966) to be! appnixtately 2,000 Indian students In both the grade 6 and grade 9 
in the grade 12 sample, given 1,61 Indian students reported in the grade 1 sappln. 



1,500 students 
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At least a sizable (N«600+) up to very Impressive (N=25,000+) number of Indian 
students are represented by these data sets. However, the 1970s data are the 
least complete in terms of numbers of Indian students (and In terms of school 
districts), and are likely the least reliable. It is unfortunate that so 
little analyzable data for the 1970s art available: research published during 
this time focused on the 1960s, and the 1970s has thus far been largely 
unreported. 

Figure 2-1 plots the reading achievement data from Table 2-2 to provide a 
picture of how the four time period data sets compare with each other and how 
each varies across grade level.. Surprisingly, the igsQs^valuatlon sample 
data and 1960s data nearly coincide. Both data sets show a pattern of 
relative decline in reading achievement with grade level, as often noted in 
the educational literature (e.g., Berry, 1968; Coombs et al.. , 19W); However, 
both are substantially more favorable than the ^ 960s or 1970s datr, and not 
far below the normative comparison group. 

The Arizona/New Mexico 1980s reading data, in Figure 2-1, are somewhat below 
tKe study sample data and the 1950s data, but, Tike the other, are generally | 
above the 1960s and 1970s. As the slope of the data trend Tine across grade 
leyeVls quite flat, these data do not show the "classic" widening divergence 
from the norm or overall decline with increased grade level. 

f .. * t ". • •***-. 

The patterns of the 1960s and 1970s reading data, in Figure 2-1, are more ^ 
erratic than the other time period data sets, but" clearly are substantially 

lower than "either the period immediately before (1950s) or after ( 1980s ). " 

Furthermore, the 1970s data generally are lower than the 1960s data. J 

Table 2-3 provides additional perspectives on the effect size data for reading 
achievement. The mean effect sizes by-time period samples range 'from -.36 <to% 
-1.26. All are below the comparison group mean and range from what Is 



^any studies with report or publ1cation€|tes in the 1970s had collected the 
data In 1960s (e.g., Albert, 1971)^ 35 . . . r 
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TABLE 2-3 

REPRESENTATIVE INDICES OF EFFECT SUES By TIME PERIOD 



Achievement Test Types and 
Time Period 



Head Effect 
Size (Z-scora) 



T-Score 
Equivalent 



Percent of Indian Mean , Grade Level 
Students Scoring . Sample Size 




1910s 
1960s 
1970s 
1980s 

9s 



Study Sample) 



P 



95C 
1960s 



1910s 
1930s 



Study Sample) 
AZ and NH) 



-.37 
*,96 
•1,26 
-.36 

-.83 



-.42 
-1,04 
•1,0} 
-.38 



46 

■ 40- 
i 37 
i 46 
I 44 



46 
40 
40 
46 
45 



64! 
831 
901 
641 
741 



661 

85$ 
651 
681 



339 
,030 



704 



2, 



337 
1,084 
74 
704 
2,423 



SELECTED ESTIMATED t-TESTS FOR DIFFERENCES IN REPRESENTATIVE EFFECT SIZES BY TK4EHV 1 



RE, 



EVEti 



MATHEMATICS ACHIEVEMENT 



SG 



t-Test 



1950s vs 1980s 
1950s vs 1960s 
vs1970r 
tStudy) v$ 
930 (AZ a 



-9.49 
4.73 

■6.43 



Significance 

N.S. . 
p<.001 

p<.oi : 

p<,00l 



arisen 



1950 vrlfSO 

1950 vs 1960 
1960 vs 1970 
I960 (Study) vs 
1980 (AZ and* 



t-Test 

0,12 
-9.87 



nee 



N,S. 
p<.») 
N.S. 



•2,00 



38 
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considered moderate "size (tue 1950s and 1980s samples) to relatively large 
effects (the 1960s and^ 1970s samples) . These effect size! can be assessed in 
terms of T-score equivalent^ (Table 2-3)/ whejreoy the 1950s and 1980s samples 
are not far below the comparison group standarc of 50, but the 1960s and 1970s 
samples appear substantially lower. However, in terms of percentage of Indian 
students/ these range from 64$ scoring below the comparison group mean (for 
1950s and 1980s study samples) to the sub-standard performances of the 1960s . 
(83% were below the comparison mean) and the 1970s (90%). Also. in Table 2-3 
are approximate estimates of statistical significance of the differences 

- between the representative effect sizes for selected time periods. The 
estimated t-test 7 data yield no significant differences in reading achievement 
for 1950 versus 1980, but show highly significant differences between all 
other time period samples (1950s vs 1960s; 1960s vs 1970s; and the 1980s study, 
sample the vs 1980s Arizona and New Mexico sample). Further, it is safe to 
assume that all other time period comparisons would be significant- beyond- the 
p<,01 level. Finally, taking the effect size value closest *to the Comparison 
group (grade 5 reading achievement in the 1980s study sample* Z=-. 19, N=848: * 
Table 2-2) an estimated +=5-53, p < ,001 Is obtained, Thus, all grade level 

- reading achievement sizes for all time periods can.be expected to be 
significantly below the comparison group , to approximately the p<*.00l level 
or beyond. 

Table 2-4 indicates the representative effect sizes for reading achievement 
(and mathematics - discussed later) for grades 8 and below^nd for grades 9 -/ 
- and above, The difference betwtfen these provides a basis for measuring the 
extent to which Indian student scores are comparatively less favorable as 
grade level increases- The drcp relative to the comparison groups ranges from 
zero, for 1960s reading achievement data (difference *.+.02)» to -.28, for the 
1970s, While four of the five differences are statistically significant, 
given the large sample sizes, and represent a relative decrement with grade as 



^General ly, precise statistical tests cannot be readily calculated from the 
effect sizes Sslng the Glass approach or from the information available. 
However, t^values calculated (by using this mean effect size across grades and 
the* mean sample size pen grtde) are sufficient for an overall, approximate 
estimate of statistical, significance across time periods, when all data are 
readily available and more elaborate methods used .(e.g. • via Hedges, 198Zr 
Gi aeon 1a arid Hedges, 1982; Rosenthal & Rubin, 1982). . - # 



TABLE 2-4 



CONTRASTS OF GRADE 8 AND BELOW VERSUS GRADE 9 AND 
ABOVE EFFECT SIZES FOR ALL TIME .PERIOD SAMPLES OF STUDENTS 



Achievement Type- and Sample 



Mean Effect Size Mean Effect Size 
ftr Grade 8 1 Below for Grade 9 1 Above 



(z-score) 



(z-score) 



Difference 



Estimated 
Wests and 
Significance 



Reading ; 

1950s 
1960s 
1970s 

1980s (Study Simple) 
1980s AZ-and NM 



s 



1910s 
1970s 

T980s (Study Sample) 
1980s (AZ and NM) 



-.31 
-.97 
-1.14 
-.29 
-.61 



-.35 
•1.25 

-.SB 

-.35 
-.46 



-.43 
-.95 
■1.42 

-.49 
-,66 



-.51 
-.89 
■1.10 
-.47 
-.50 



-.12 M.00, p<.ffl \ 
+.02 U.S. 

-.28 t=-3,78, p<,001 

-.20 tM.50, p<,001 

-.05 i=-3,97, p<.001 



-.16 tM.QOiPX.HI' 

+.36 H-15.65. p<.001 
-.12 N.S. 

-.12 t-3.91, p<.001 

-.04 t=-3.15, p<,Ol 



\ 



41 



9 
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typically reported In the literature (e.g., Coleman et al. , 1966), they are ' 
either very small (-.05 and -.12) t/o relatively small (-,20 and -.28) by usual 
standards for effects sties- Further, one (1960s reading achievement) can be 
considered flat; that is, the relative disadvantage of Indian students appears 
to be essentially constant across grades (by thi| trends test) In the 1960s* 

Figure 2-2 presents the reading achievement mean scores collapsed Into four 
grade ranges: lower elementary (grades i*3), upper elementary (4-6), junior 
high (7-9), and senior high (10-12), for a clearer picture of time period data 
sets by "smoothing out" the data variation present at Individual grade 
levels. The similarity of the 1950s and 1980s data becomes more readily 
.apparent, as does the tendency for Indian reading achievement to diverge from 
the norm with increased grade level. The flatness or lack of trend of the 
Arizona/New Mexico 1980s data is also more readily seen, Finally, the 
relative position of the 1960s and 1970s data, with the relative decline in 
1970s performance, becomes more clear. Also, the 1970s data show/ a modest 
"classic" slope (divergence) downward with Increased grade, while the 1960s 
data show a tendency to converge, toward the comparison group mean , from lower 
elementary to junior high, and then to diverge again. This latter pattern, 
found in 1960s data, appears quite unusual and is different from the " 
traditional picture of Indian student achievement declining across grade 
levels portrayed in educational literature (e.g., Havighurst, 1971), 

.When the present meta-analysis began, it was expected that a steady 
improvement would be found in Indian achievement with the addition of, first, 
Title I and other programs generally targeted to the disadvantaged (1960s), 
followed by the Title IV Program targeted to Indian students (1970s), 
culminating in the institutionalization of these programs (1980s). Instead, 
the progress has been Irregular. It appears that the relatively favorable 
situation of the 1950s deteriorated somewhat in the 1960s and further In the 
1970s, but that tfie~1980s results again approach the level of 1950s. This is 
essentially true for each grade range. This picture of change over time is 
depicted In Figure 2*3, where curves for each collapsed grade level (lower 
elementary, upper elementary, junior high, and senior high) are plotted across 
the four time periods (1950s, 1960s, 1970s, and 1980s).' 
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The mathematics achievement scores-of Indian students, plotted In Figure 2-4 
show both similarities to and some differences from the reading achievement 
data of Figure 2-1. This should be expected as the same studies usually 
supplied both reading and math, and these variables are correlated. As in the 
reading scores, the*195Qs and 1980s mathematics data virtually overlap; they 
are relatively close to the norm, and decrease gradually with increased ^ 
grade. The 1980s Arizona/New Mexico data pattern Is again relatively flat ^ 
across grades, but more favorably so, essentially ovarlapplng the study data 
and the 1950s mathematics data from grade six oft, The 1960s and 1970s 
mathematics data are again well below both 1980s and the 1950s levels. In 
this case, however, the 1970s data are more favorable than the 1960s^data for 
the upper elementary grades. 

Returning to Table 2-3, all the representative Indices of effect sizes by time 
period for the mathfimatlcs achievement data are found to show roughly the same 
pattern as the reading achievement data. This Is not surprising, as reading 
achievement and mathematics achievement are generally correlated, but it does 
provide some cross-validation of the reading achievement results previously 
reported. Similarly, the estimated t-tests provide the sane pattern^of 
results, except that the overall 1960s versus 1970s mathemat1cs~ach1 element 
data. It appears, are not significantly dlfferept statistically. 

Examining Tab-le 2-4, ithe effects for the mathematics achievement data also ar? 
found to show>genera11y the same patterns as the reading achleyement data, ^ 
with, two exceptions. The 1960s data show a moderate and Highly- significant ^ 
improvement between the lower and upper grades, and the 1970s data are not ^ 
statistically significant between the lower and upper grades, the remaining 
three time period samples, /while highly significant statistically, show v?ryv | 
small drops between lower and upper grades by the usual effect size standards. 

As with the reading data, the mathematics data are clearer when grade levels; 
ate collapsed into grade ranfije. as shown In Ftgiire °2-5, and are similar to the 
reading data plotted 1n Figure 2-2. The plot^f mathematics data over time / 
perlods.Hf Figure 2-6, Is also generally slm/lar to the reading data In r* 
Figure 2-3, but the upper /elementary 1960s data 1s lowest, while the 1970s 
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junior and senior high school data are somewhat lower than the 1966s data* 
The pattern of most favorable Indian achievement data occurring in the 1960s 
and in the 1980s is repeated in the mathematics data* 

One possible explanation for the drop during tne 1960s and 1970s, compared 

with the 1950s, is that Indians in public schools in the 1950s were 

self ^selected (e.g., high S|Sj" and academically superior to their non-public 

school counterparts. With the advent of the entitlement programs of the 1960s 

and the closing of BIA schools in the 1970s, greater numbers of the less 

academically able Indians from mission and federal (BIA) schools entered 

public schools, thereby depressing average achievement levels. This 

hypothesis 1s supported by the data presented in Figure 2-7. The three upper 

curves, from the Coombs et al. 0968) study, show public school Indians 

generally superior to their federal school counterparts, with both generally 

superior to mission school Indians* However, the lower two curves, from the 

Bass (1971) study, show public school Indians superior to Indians attending , 
_ _ - - / 

federal schools in the tenth, eleventh, ana twelnn grades* ind both T~y 

dramatically lower than any of the three Coombs tt samples* It should/6e / 

noted. that three of the five geographically dispersed school districts , / 

represented 1n the Bass study were the same as three of the six geographically 

dispersed school district^ in the Coombs study, making the two studies/ 

acceptably comparable* , / 

■ ■ f 

Another, more complex, explanation is that the influx of Indian children Into 
the public schools not only lowered the average academic level, but consisted 
of students who floundered In "their new environment* The public schools, the 
theory 'contends, were not prepared to deal with the influx of q culturally 
different group* This may have delayed the impact of Title ly Title IV, and 
other federal programs in helping the public schools better swerve this group. 
Moreover, Title IV, Part A may have ultimately encouraged the entrance of a: 
larger, more representative sample of Indian students (closer to academic 
achievement norms) Into the system - ergo the 1980s result^. 



/ 
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Finally, it should be noted that, as this meta-analysis was nearing 
completion* an additional set of data points on American Indians irt the* 1980s 
for tenth (N-278) and twelfth (N-217) grades was obtained and included. These 
are from the "High School and Beyond Study" (Takal & Huddleston, 1982)* As 
this study is based on a national probability sample, it yields data very 
similar to that of the Development Associates national study of Title IV- 
served students.^ These findings lend additional support to the conclusion 
that American Indian reading and mathematics achievement* particularly i,n the 
upper grades, is as high or higher than it has been at any time in the last 
thirty years. Nevertheless, these remain well below national .norms, and the 
academic needs of Indian students have not been met* 



8"The effect sizes represented by reading scores for tenth and twelfth grades Jn 
the tifgfi School and Beyond Study (-.38 and -.34, respect tvely) are very similar, - 
although somewhat more positive* to the tenth and eleventh grade reading scores 
obtained by Development Associates (-.57 and -.55). The effect sizes represented 
by mathematics scores in the High School and Beyond Stu% for tenth and twelfth . 
grade (-.46 and -,41, respectively) are even more similar (-.42 and -.57 for 
Development Associates). / 
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CHAPTER 3i DESCRIPTION OF TUTORIAL AND RELATED ACTIVITIES 
DIRECTED TOWARD BASIC ACADEMIC SKILLS 

Aurora Martlnollch* Robert Russell, And 
Paul Hopstock 

A* Introduction 



An important purpose of the Indian Education* Program has been to Improve the 
academic skills of Indian children* According to the Part A regulations, ^ 
wide variety of supplemental academic activities may be provided to Indian 
children, including individual or group Instruction in basic academic skills, 

accelerated training for "gifted" students, and remedial instruction* 

» *_ 

While there are a variety of ways in which Part A projects provide assistance 
to Indian students to improve their academic achievement, the most widely 
employed approach Is through tutorial or related academic services* An 
estimated 80% of all Part A projects provide some form of tutorial or special 
academic assistance services J 

This chapter describes the nature of academic/tutorial services which are 
provided to Indian students under the Part A Program, Evidence concerning 
the Impact of academic/tutorial services is presented In Chapters 4*8, 

B, Procedures 

^^^^^^^^^^^^^^^^^ * * 

During the fall site visits^to each of the 115 projects In. the study sample,"" 
project directors were asked whether or not cheir projects provided tutoring 
or other speciaWcademlc activities* If tutoring or related special 
academic activities were a component of the project, four data collection 



U somewhat smaller proportion (73X) of school districts on or near 
reservations and a somewhat higher proportion (90%) of metropolitan school 
districts had Part A tutorial/academic activities than did the overall 

^^pof tion;- VI rtual ly the s^6 ^opertlon of d 1 str 1 et s In other rural areas 
(fill) or In urban, npn^tro^ supported tutorl al/academlc 

activities as 



Instruments were left with the project director for completion. The 
"Overview of Tutorial/Special Academic Activities*" which asked for a 

description of the tutorial activities within the project, was to be — 

completed by the project director or person supervising the tutorial 
activities (N s 90) . The other three were to. be completed^by the tutors 
themselves* The "Tutor Ch ar aet^r 1 sties" questionnaire requested background 
information on each tutor and their project activities; 329 tutors completed 
this form. The remaining two Instruments focused on the characteristics of 
the tutored students. ^The "Characteristics of Tutored Students" form was to 
be completed for each student to be tutoreteat the beginning of the school 
year or upon entrance into the tutorial program. Another, the "Post r Tutorial 
Fol low-Up" form, was to be completed for each tutored student either^ at the 
time tutoring was completed or discontinued, or during the spring visit Jby 
the field staff, whichever came first. The latter two forms were completed * 



for 2,599 students/ In addition* the "Characteristics of 



utored Students" 



form, alone, was completed for 405 students, while the "PofE-Tutorlal 
Follow-Up" form alone was turned in for 224 students* 

Flnfllnqs 1 

~~\ ■ t - • / 

Purpdse and Scope of Academic Activities . 

The tutorial and related academic programs which are provided by the Part A 
^Program were almost entirely supplementary 1n nature* 0nly^5% of projects 
reported Resigning academic activities to take the place of regular school 

classes, wlththe remaining 95% designing programs solely to supplement 

existing classes. 

i - 

■ , / , . * / ■ : 

Academic and tutorial activities were perceived as extremely important 
relative to other activities 1n Part A projects* These activities were rated 
as extremely Important by 82% of respondents 1n projects with academic 
Components, and as moderately Important by an amftlonal 14%* The main 
purpose of tutorial and other academic" actlviti^ was perceived to "be the 
Improvement of academic skins by students> iUhough there were a number of 
perceived secondary purposes, such as^the enhancement of student 
se If -concept s t the ^Improvement of student attitudes toward school, and the ? 
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provision of support and encouragement to students. The average tutorial 
program was reported to have been in operation for approximately five years, 



Tutoring Sessions 

Tutorial and other supplemental academic activities were generally held In 
school during school hours, and were oriented to regular classroom 
Instruction. Two-thirds (66%) of the tutoring projects focused tutoring 
directly on classroom material* However, one-third (31%) of these projects 
provided tutoring which, although in the same content areas as those being . 
covered in regular classrooms, was not linked directly to classroom 
materials* Most of the tutoring projects offered tutoring in "basic" subject 
areas, including mathematics (90%) , reading (89%), writing (62%), and other 
academic areas (48%). Over two-thirds (67%) of the tutoring projects held 
tutoring sessions during school hours* Seventy percent of the academic 
projects held tutoring sessions in schools; the remainder of vthe tutoring* 
projects held sessions In community centers (17%), churches (7%), or in 
students 8 homes (6%h 3 ? * 

* 

i » 

The scope of tutoring activities was usually determined by someone other: than 
the tutor « by the pVoject director In nearly half of the tutoring* projects 
(46%) and the student 1 ! teacher In over a quarter (27%). A variety of 
materials were used in the sessions: class assignments, texts, or workbooks 
(87%); tutor-prepared materials (75%); materials purchased by trie project or 
school (58%); games or other Informal materials (66%); a^d programmed 
materials provided by the -project or school (43%). 



j 



Ztutorlng programs located 1n metropolitan (40%Kor in f urban, non-metropol itan 
(41%) arreas* were more jlkely to hold tutoring sessions outside regular school 
hours than, were programs on or near reservations (16%). or in other rural areas 



3a greater proportion of projects in urban, non-metropbl itan areas (61%) held 
tutoring in locations outside the school than was the case for projects located 
on or near reservations (26%), in other rural areas (12%), or in metropolitan 

-ar#as^- 37%) . — — - — . - v - ' 
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* The tutoring programs appear to have been relatively intense* given their 

supplemental nature* Most (81%) programs operated throughout the school 

year: The typical student attended a medijii^of four sessions per week, with 

> a median duration of 35 minutes per session* Students received a mean of 66 

4 * 

hours of tutoring during the school year. According to the tutors, mosp 
(88%) of the students attended regularly. 

Over two-fifths (44%) of the tutoring projects assigned tutors primarily on a 
one-to-one basis* Nearly half (47%) relied upon small group instruction (j*^ 
tutor with several students), A small proportion (9%) of the tutoring 
project: used both methods interchangeably* 

Tutors* students, and the students 1 families often developed relationships 
beyond tutoring* In 75% of the tutoring projects, tutors had informal . 
contacts with students outside the sessions* One-third (32%) of the tutors 
took students on outings and field trips as a regular part -^f the tutoring 
^program; 21% took students on Informal outings. In 56% 'of the tutoring 
projects, tutors were acquainted with the students' parents; in 15%, frequent 
tutor-family contacts were reported. * V- 

Student Recruitments Assignment, and Termination 

In 52% of the tutoring projects, students were typically referred for special 
help by teachers or other school Staff on the basis of their Informal 
assessment of the student's academic progress* Achievement test scores were 
used as the primary basis for referral In one-third (31%) of these projects, 
while in only 6% of the projects did studtfrCs enter tutoring primarily on 
their own Initiative. Tutoring projects assigned students to tutors on the . 
basis on an Informal judgment of compatibility by the teacher or tutor 
coordinator (36%), as tutors became available (33%), or on the basis of 



*The mean* number of hours of tutoring received throughout the school year, by 
students on or near reservations (71 hours) and in other rural areas (79 hours) 
was hi^e* 4 ***** that r^jy^H hy students in urban. non-metropolitan (48 hours) 
or metropolitan (38 hours) areas., 
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specific criteria (28%), such as matching the specialty of the tutor with the 
needs of the student, 

* 

Tutoring projects monitored student progress by one or more methods (see 
Table 3-1). Most (86%) of these projects terminated tutoring when a student 
reached an acceptable level of academic achievement, although 26% also 
terminated tutoring if a student was Irregular in attendance, 

• . I 

TABLE 3-1 

METHODS USED TO MONITOR ACADEMIC PROGRESS OF TUTORED STUDENTS 

(Weighted N=690)* 



* Percentage of All 

Methods " Academic Projects 



Tests 7 f* 

Informal interviews with tutor/teacher « 

Periodic wrffte-ups of student progress- by tutor/teacher 47 

Formal Interviews with tu|or/teacher 25 

Tutor/teacher grading system. •» ~2 

Daily log Books or records * . , s* 

No monitoring was done . • . j. 



*The actual number ov projects with tutoring in the sample was 90. Data were 
weighted to make the findings representative of all academic projects. 



Characteristics of Tutors and Tutor Training . . 

' / •• • • \ 

Tutors /iad an average age of 33 years and were predominantly female (84%) and 
Indian /(68%). Nearly half (46%) tutored at the elementary level (grades 
K-6), 32% at the secondary level (grades 7-12), and 22% at both levels. 
Cultut/al sensitivity and awareness, special academic abilities, and 
sensitivity to student needs were most often cited by tutors as the special 
abilities they possessed which were useful In tutoring (see Table 3-2). 
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TABLE 3-2 j . 


- 


■ SPECIAL ABILITIES OF TUTORS j 
(N=311) ; 

^ t x f ..... 1 




Abilities Cited 
by Tutors 


Percentage of 
Tutors 


l 

Special ability in academic area 
Cultural sensitivity and awareness as an Indian 
Sensitivity to student needs r relating well to students 
Teacher certification or former teacher , . j 
Knowledge of India/i heritage and culture 1 

t i 9 


35% 

29 
18 
18 



In most' (94%) projects, tutors were paid as hired employees; only 6% of the 
projects used volunteers as their primary source of tutors. Project 
directors selected or hired tutors in 60% of the projects, although others 
such as the parent commi tteejy^d+stf^t administrators also may have be#p 
involved In the hiring or approval of tutors in some projects. One-third 
(34%) of the tutors became aware of the tutoring position because they worked 
for the school or district. , Other tutors learned of the opening through 
advertisements (10%), were recruited by the parent coimlttee (10£) f were 
referred by a teacher (fflOs volunteered (7%) s or found out in other ways* 
Nearly three-fifths (57%) of the projects provided training for tutors* in a 
variety of areas (see Table 3-3). 



Topic 



TABLE 3-3 

TOPICS COVfRID IN TUTOR TRAINING SESSIONS 
(Weighted N^394)* 



Percentage of Academic Projects 
with Training Which Cover Topic 



Subject matter content (review of area to be tutored) 

Cultural sensitivity 

Techniques of teaching subject matter 

Use of tutoring materials 

Methods for motivating and maintaining student interest 

Administrative procedures - 

Social skills (ho* to build rapport with student) 



58% 
58 
56. 
56 
54 
*52 
49 



★The actual number of projects providing training was 44. The data were weighed 
so the findings are representative of all academic projects* 
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Description of Studants 

Students from ill grade .levels received tutoring, although the bulk of 

chndren receiving tutoring were at the elementary level*' Ngarly ^ ^ 

three-fifths (57%) of tutored students were in grades while one-third 

(35*) were in grades 7-9. Only 7% were in grades 10-12, Slfghtly over half 
(hz%) of the tutored students were male, Two-thirds (66%) of the students 
were 4 1n their first year of tutoring; 23% were in their second year. 
One-third of the students were tutored on a one-to-one basis; two-thirds were 
Instructed in small groups* 

A majority of students were tutored in reading (57%), or math (65%) , while a., 
minority were tutored In writing (21%), social studies (15%), or In other 
areas (18%) . , In reading and mathematics, tutors rated two-thirds or more of 
their Students as "low" or "below average" relative to their peers at the 
start of the tutoring sesions (see Table 3-4) t A majority of students were 
also rated "low 1 * or "below average" In other subject areas* Fewer than 10% 
the tutored students v*ere rated as "above average" or "superior" irv any 
subject area* From the perspective of the tutors, then, most of these 
students were in need of remedial instruction at the start of the tutoring 
sessions* ? * 

Tutors also rated students regarding their school conduct, se^f -confidence, 
and Interest in school (See Table 3-5). Roughly half of the tutored students 
were rated as "average 11 In all three areas* In school conduct,- roughly even 
numbers were rated "above average" or "superior" as were rat^i "below average" 
or "low." However, a much larger proportion of tutored students yere rated 
M low" or "below average" in self-confidence and interest^ 'in school .than were 
rated "above average" or "superior"* Thus, at the start of the tutoring 
sessions* the tutored students were probably typical of students In their 
districts with respect to school conduct, .but may have Seen somewhat lower In 
se lf-confidence and interest in school* ^ 



67 % 
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* ACADEMIC LEVELS OF TUTORED STUDENTS AS RATED BY TUTORS 
AT THE START OF TUTORING SESSIONS IN 1981-82 

(N=3528) 



9 

Subject Area 




= Mean 


Percent of 
Students 
Tutored in 
Area 


Low 

(J) 


Below Above 
Average Avirage Average 
(2) (3) (41 


Superior 


Reading 


2023 


2,02 


57% 


27% 


47% ... 22% 


3% 


1% ' 


Mathematics 


2293 


2,16 


65% 


21% 


48% 26% 




1% 


Writing 


753 


2.26 


.21% 


24% 


34% 35% 


6% 


1% • 


Social studies 


518 


2.29 


15% 


23% 


36% 33% 


5% 


3% ' 


Otljer 


646 


2.09 


18% 


32% 


37% 22% 


8% 


1% 








TABLE 3-5 








SCHOOL CONDUCT* SELF-CONFIDENCE, AND SCHOOL INtl 
TUTORED STUDENTS AS RATED BY TUTORS AT THE START OF TUTORING 

(N-32S8) 


REST OF 
SESSIONS 

\ 


IN 1981-82 

/ 






Mean 


Low 

{?.); * 


Below 
Average Average 
(2) (3) 


Above 
Average 

(*)_. 


Superior 
\ (5) 


School conduct 




3.07 


8% 


19% 


45% 


14% 


' ;\ 14 « ■ ^ 


Self-confidence 




2.70 


• 7% 


29% 


51% 

* 


10%. 


3% 


Interest in school 


2,68 


10% 


26% 


53% - 


9% 


2% 

\ 



Four-fifths of the Part A projects provided tutorial or related academic 
programs which were almost entirely supplementary In nature. Most tutoring 
programs offered tutoring In readi (89%) and mathematics (90%) , Tutoring 
sessions were generally held In schawl during school hours and oriented to 
regular classroom Instruction, * Tutoring activities were relatively intense, 
with a typical student attending four sessions a week throughout most of the 
school year. 

Most tutors were adults, female (84%), and Indian (67%) . Most (94%) academic 
projects paid tutors. The majority (57%) provided tutor training In a 
variety of areas. 

The majority (57%) of students receiving tutoring was at the elementary 
level. Tutored students were generally In need of- remedial help; at the 
beginning of tutoring, tutors rated two-thirds or more of the students 
tutored In reading or mathematics as low or below average- Students were 
generally rated as average in school conduct, but were rated somewhat lower 
than average in self-confidence and Interest In school* 



CHAPTER 4* READING AND MATHEMATICS ACHIEVEMENT TEST SCORE PATTERNS OF 
INDIAN STUDENTS SERVED BY TITLE IV, PART A 
PROJECTS IN PUBLIC SCHOOLS 

Milton Goldsamt and Earl Jones ^ 
Introduction 

Improvement of the academic performance of Indian students has been a major 
thrust of the Title IV, Part A legislation. As part of assessing the Title 
IV, Part A Program, data were collected concerning the achievement test 
scores of Indian students in school districts with Title IV projects, Jfie 
study thus offered insights into the ongoing basic academic needs of 
Indian/Alaska Native students* — 

Title IV projects are addressing academic needs, as over three-quarters of 
the sampled projects were found to have a basic skills emphasis of either 
increasing student academic abilities or the ability to communicate in the 
English language* For -example, 60% of [sampled Indian students in grades 7-12 
stated that they had worked with a teacher or tutor from the project In 
reading or English language arts* while ^6 7% cited help^from a project- 
supplied teacher or tutor in mathematiesl Projects are stressing both 
remedial and enrichment Instruction* Close to three-fifths of sampled 
students In grades 7-12 reported receiving tutoring for purposes of 
eliminating skills deficiencies* and one-quarter o^he students stated that 
they had learned additional material to put \them ahead of their classmates.; 

The variables and dimensions included in this\study represented extensions of 
a number of ongoing investigations in the literature on the correlates of 
academic performance* Such Investigations included research on the magnitude 
of relationships between academic achievement and socioeconomic status 
(White* 1982) and self -concept (Hansford and WattVe, 1982),^ 

In examining the results of this chaptw^^w^yer* care should be taken in 
viewing achievement test data as the dominant measure of academic Impact* 
Academic components of Part A projects are almost exclusively supplementary 
in nature" and they are d1reet*d at subpopulations of Indian students. Part 



A projects f therefore* should not be expected to produce major improvements 
in the achievement test scores of the overall Indian student population.. The 
data were analyzed* however* to see if the existence of specific program 
components &r levels of student contact with Part A projects were related to 
achievement test scores. 

L ■ 

. Methodology 



Overview 




A cross-sectional design was used in this phase of the Indian Education 
Evaluation Study. That- is, the study focused on determining whether there 
were differences across comparison groups of students and projects. 
Standardized achievement test scores were used as dependent measures. The 
time frame for the evaluation precluded the longitudinal data collection to 
ascertain if students 1 academic performance had significantly shifted. Time 
and Cost factors also dictated a file search procedure rather than systematic 
student testing. Field study teams were therefore trained to collect reading 
and mathematics scores from LEA files, based on trie spring 1981 testing 
programs conducted by those districts In the sample. Data recording forms 
were used to obtain scores of students in the evaluation sample. Uhere 
possible* summary data were also collected for all students In the district 
tested at the same grades Included in the evaluation study. Individual . . 
students* scores were uniformly transformed to T-Score formats. Analyses of 
these scores were subsequently conducted to determine which of several 
student* local program, and contextual characteristics were significantly 
associated with reading and mathematics scores. - 

Use of Test Score Information 

Based on information gathered during the fall visit to sample projects* a 
series of criteria was developed for determining what type of tests would be 
used as sources of reading and mathematics test scores. The criteria for 
selecting types of reading and math scores from student files were the 
following: 
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• Scores represented testing administrations conducted in the spring of 1981* 
that is, no earlier than January of that— year; 

• Students for whom scores were collected were currently In any of the grades 
4-12, thus likely were in grades 3-1 1 when the spring 1981 testing was 
conducted; 

• Tests were not state-developed, locally-developed, criterion-referenced, or 
objectives-based (since these would have no direct psychometric basis for 
comparison with standardized instruments); 

t Tests were not diagnostic reading and math standardized Instruments; and 

t The district tested a range of grades rather than a limited range or 

scattered ones (thus permitting aeruss-grade comparisons among a common set 
of projects if desired) . 

These criteria were provided to study field staff and explained to them 
during formal training sessions, - 

All reading and mathematics test scores 1 available on the sample students, 
from tests considered suitable for study purpos§s^were collected* The 
test's name, form, level and grade in which administered was recorded. Most 
tests were represented by more than one edition, Each alternative form 
having distinct means and standard deviations was recorded. Although 
districts did not always maintain f orm-type"Thf ormat ion in their files, these 
were usually identified from the level designations and from the range of 
scores. When such an identification was not possible, the person heading the 
testing program was contacted to obtain the needed Information, 

Most districts administered the, level of the test designated for each grade* 
A few utilized the level suitable for the performance level of the student 
(I.e., "out-of-level" testing), Norms had been created for almost all of the 
tests "for at least one grade above and one below the designated grade. _If 
thosfr norms were published, then the level was accepted, When norms for a 
grade were not available, the collected scores were disregarded, V-r^ 




Tin the case of a test battery, the most relevant subtest used, based on a 
series of criteria supplied field staff, This usually was the comprehension 
subtest for reading* and the quantitative or Confutation subtest f on mathematics, 
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The scores were found In distrftt and school files in a variety of formats. 
Raw scores were preferable since they reduced thi difficulties with subsequent 
transformation (to T-score) activities. The rtfcer frequent formats 
encountered Included grade equivalents,, percentile ranks, scale scores, 
normal curve equivalents* and occasionally standardized T-scofes. Most of 
.the test publishers provided the tables necessary to convert these formats to 
raw -scores for individual students, A few, however, did not furnish their 
formulas for special group scores and those could not be processed. Stanines 
were also found in a few districts, but it was very difficult to convert 
them, so those scores were not used. 

The percentage of test scores which could not be used because of difficulties 
in transformation was about 5%, not an unusually large proportion. The total 
of reading and/or mathematics stores considered usable was 6,425, which 
represented approximately 481 of the 13,480 students in grades 4-12 included, 
in the sample. Almost all or the loss was occasioned by- districts th^t did 
not test students, and districts that did not test every^grade or a wide 
cange of them, Even though some grades were not availablecfrom some 
districts, the overall sample included substantial numbers of students from 
grades 4 through 12, the levels Included In the study. 

The extent, If any, of bias present from using data .from approximately half 
of the sample students was analyzed in terms of project and student 
characteristics. A total of 77 (67%) of the 115 projects contributed student 
test scores to the data pool, Series of analyses were conducted to determine 
if the characteristics of the 77 projects and districts differed 
significantly from those of the remaining projects not included in the 
subsample of test score sites, Geographic location, proportion of Indian 
students to all students (a density measure), geocultural region (12 
categories) * and Title IV Technical Assistance Region (S categories) were 
used. For none of these variables did the 77 retained projects differ 
significantly from the remaining projects* (Chi -square "goodness of fit" - 
tests of significance and examination of percentages were used for these 
purposes.) - - 
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At the student level, the characteristics of the 6,425 students were compared 
with a group of 12,539 students who had completed the spring set of student 
instruments, and thus Included the vast majority of fche full student sample 
from all US projects. Again "goodness of fit 1 ' statistical tests and visual 
inspection approaches were applied to detect any large-scale or meaningful 
differences between those contributing test score data and the full student 
sample* These comparisons were made on the basis of geographic region of the 



projects 'serving these students, grade level , and location of the projects. 
Again, no siiable differences were found in what types of students had usable 
test score Information* \ 

FlnaMy, most analyses of between-group differences were conducted on a large 
data base having fewer than the 12,539 Indian students, although it did 
number 7, 644. This group consisted of those students having attitudinal 
and/or atten ^nce and/or achievement information (a merged-f He data base 
widely used ror a variety of analytic purposes). A check on the similarity 
of data ftfr this grou^and the full student sample was therefore deemed 
advisable. Socioeconomic- status (i .e., whether br not the student received 
free or subsidized lunch), age, sex, . and grade were used for these 
comparisons* Again there was a high degree of similarity on virtually every 
category of each variable Examined; 

In summary, it seems highly likely that in terms of the demographic and 
contextual variables used, the students contributingnest score Information 
were quite similar to the full student sample* No measurable bias that would 
make the findings unrepresentative of the full sample was introduced simply 
on^the basis of using available data." - 

Test Score Conversion . - 



The extensive and ongoing literature on how best to equate or convert scores 
from odffertent tests and forms at, differing or Identical grade levels to a 



common metric for comparison purposes does not provide a definitive answer 

2 

regarding which approach is most defensible* Different tests have varying 



~2see for e&amplei Goldsamt and mggs li^u)j Linn (I38UI or «aggs and lissom 
(1982), ^ 

; - * 74 ■ : * — . __s 
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numbers of items* and those Items represent some differences In content, 
compatibility with the curriculum, and examinie appropriateness. The 
much-quoted Anchor Test Study (Loret et al-, 1975) compared reading scores 
across five tests for three grades and found few important differences. A 
later publication (Jaeger, 1977) reexamined some of the findings based on 
normal curve equivalents (NCEs), and disagreed with some of the premises and 
with the validity of using the NCE conversion procedure* 

A recent review by Thompson and Novak (1981) reported varying results when 
scores from several tests were used. Their own research, using very large 
numbers of students, found many consistent normal curve equivalent shifts or 
gains across years and tests, and relatively few inconsistencies, Similarly, 
Buckley (1981) found only minor differences across tests, Earlier, 
Silver berg and Sllverberg (1977) had found generally comparable data across 
"standardized reading tests. 

Early in the National Institute of Education-funded evaluations of the 
Experimental Schools Programs, seminars were held to determine the most 
viable test score conversion approach for data from students in that program 
(Cervantes, 1975). Testing experts chose the standard T-score as the 
conversion approach to use, even though they found some weaknesses in It* 
During the early stages of data analyses for Development Associates 1 
evaluation of California's services to limited and non-English speaking 
students (Jones et at-, 1980), a special panel was Invited to examine the 
score conversion alternatives, Theimer (1979) reviewed these ^alternate , 
procedures and also recommended T-scores./ Gabriel (1979) concurred, noting 
that of the several tests studied, the differences from one level to another 
within a test were as great as the differences among the tests- Several 
other researchers have come to approximately the same conclusion (Berman and 
McLaughlin, 1978; fflayeske and Beaton, 1975; Stal lings*. 1975). Many of the 



studies with very jarge numbers of students have us^d T-score conversion 
procedures (Jones 4nd Davis, 1977; Jones et al_. , 1980; Gabriel, 1?79) ;' 
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The California Department of Education ( 1 977 t 1979) utilized this same system 
for the state evaluation of consolidated application programs* and for their 
combined early childhood education, Title I, *aftd economically deprived youth 
evaluation study. In each of these publications, some problems with 
differences among tests were discussed* However, the final conclusion was 
that across-test variations arising from score conversions were relatively 
minor* 

Development Associates therefore chose standardized T-scores as the test 
score conversion procedure for the present study* The conversion formula 

emp ' /as: 

Rc.w score minus test mean, divided by test standard deviation times 10 plus 
50 ■ T-score (rounded to the nearest whole number) 

Tne large number (23) of test forms found in LEA lies together with the need 
for absolute identification of students for each set of scores, led— 
Development Associates to conduct the conversions manually* Development 
Associates/ California office staff had considerable experience performing 
such trans/formation, and a library of conversion tables amassed from other 
studies* /Quality control procedureswere employed to minimize recording 
error. The T-scores were then added to computer-designed data collection 
sheets that already had the unique student Identification numbers and several 
^Student-level variables that were anticipated as possible differentiating 

factors* The data were merged with other /files th^f contained relevant 

* * 

student and project data* 

Adequacy gf the Test Score Conversion Approach 

A detailed study of the psychometric adequacy of tests utilized by the 
districts* and the effects of converting scores from them was not within the 
purview of this evaluation. Nevertheless* Development Associates conducted 
certain analyses to furnish insights into possible test and/or conversion 
biases*. The first of these is contained In Table 4-l 9 in which the 
district-level means on all students on the test or tests used were compared 
with the means for Indian students who were part of the evaluation sample. 

. 7C 
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TABLE 4-1 

SPRING 1981 READING AND MATHEMATICS T - SCORES FOR THE OVERALL DISTRICT 
AND STUDY SAMPLE OF GRADE 3-11 STUDENTS 



District 
Code 



007 

010 

019 

021 

059. 

061 

062 

063 

064 

065 

066 

067" 

069 

070 

071 

072 

073 

074 

076 

079 

080 

086 

087 

093 

094 

095 

096 

097 

099 

100 

102 

103 

105 

108- 

109: 

110 

112 

113 

114 

116 

117 

118 



Reading 
District . Study 
Report Sample 



48.4 
54.6 
46.1 
55.2 
48.1 
50.0 
53.6 
47.8 
44.1 
42.1 
47.8 
42.6 
43.6 
41.6 
53.4 
54.6 
45.2 
64.0 
51.8 
47.2 
49.1 
47.8 
47.0 
47.1 
42. 1* 
50,2 
49.3 
50.2 
49.5 
51.1 
47.3 
50.7 
34.1 
_48.2 
50.4 
48.3 
50.2 
49.1 
48.9 
45.2 
58.6 
49.1 



50.2 
47.0 
46.0 

.57.3 
46.8 

. 43.8 



s 



3 
,0 
,9 
.6 
,5 



44, 
46. 
43. 
41. 
44. 

• 43.2 

46.1 
43.4 
54.6 
55.5 
44.5 
51.3 
44.1 
48.5 
47.2 

/^52.0 
44.0 
44.7 

* 39.0 
49.2 J 
48J/ 
S0.6 
49.1 
51.0 
46.5 
51.0 
26.5 
47._9 
49.8 
47.4 
48.1 
45.6 
48.7 
44.3 
59.1 
48.0 



District 
Report 

46.5 
56.3 
46.8 
53.8 
49.3 
49.4 
55.2 
49.2 
44.2 
43.8 
48.6 
45.2 
43.4 
43.8, 
54.6 . 
55.7 
46»4 
52.3 
49.0 
45.0 
47.6 
47.8 
46.1 
45.2 
47.6 
51.1 
48.4 s 
46.6 
50.7 
47.3 
47.1 
47.4 
58.6 
48.7 
48.8 
,47.4 
49.6 
48.4 
47.3 
31.2 ~ 
45.8 
50.2 



Mat hematics 

Study 



Sample 



48.8 
47.4 
47.5 
51.8 
45.5 
36.6 
45. 6 
49.0 
45.1 
45.3 
45.8 
45.3 
46.4 
45.4 
54.4 
54.7 
46.0 
51.8 
41.9 

5j^2_ 

48.7 

52.2 

41.0 

35.8 

47.6 

53.9 

47.4 

47.4 

53.7 

45.9 

46.7 

44.3 

60.8 

50.6 

48.7 

46.1 

48.6 

45.2 

45. T 

37.0 

45.9 

48.9 



Note: 



Means calculated only for the grades included In the samples. Students per 
4j$+ r ir* <g 10 or more: district #105 had both the lowest reading and 
highest mathematics mean scores of any district, and although. the district 
tM$nunaware,-of-~any biasing effects, It was excluded from between-project 



statistical analyses. 
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The data show that 76% of the reading score means (overall district versus 
Indian sample) and 78% of the mathematics means fell within inree T-score 
points of each other* Table 4-1 does Indicate that there were only a few 
unusually varying score patterns within districts, These generally occurred 
In districts with a small number of tested students* ^ 

The second procedure was to compare the means resulting from ail the tests 

combined with those of the test most widely used by sample districts, the 

4 

1978 edition of the California Achievement Test (CAT) * Tables 4-2 and 4-3 
contain the means for both reading and matnematlcs* as analyzed by grade and 
socioeconomic status* 

. t - 

The difference between the two sets of mean scores was 2*5 T-score points or 

^Hs^fof^-botte-readl^g-and mathe ma t 1 cs * Indeed^the^dJ^'fe^ences ^war e_ usu ally 

less than one point. Overall, the means for all students in the two groups 

were similar for reading ana almost Identical for mathematics* 

In addition, one aspect of the data presented In Table 4-2 should not go 
unnoted^ although it is not central to the present discussion (and Is 
discussed more fully later in this chapter). That is, that both the 
All -Sample and CAT78 reading and mathematics T-scqres significantly differed 
across grades (p <.001). In all instances* ther^ was a declining pattern of 
academic performance as the grade increased. The implication that the 
performance of Indian students in reading and mathematics declines as they 
* continue in school Is a serious one* \ 



3These districts were excluded from analyses at the project level. 



4Qne-f ifth of the* districts supplied scores either solely or predominantly from 
•this test; one-third of all students had 1978 CAT scores* \ 
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: TABLE 4-2 

THE ALL-SAMPLE AND THE 1978 VERSION 
OF THE CALIFORNIA ACHIEVEMENT TEST ( CAT78) SAMPLE READING 
: AND MATHEMATICS T-SCQRI MEANS. SY GRADE 
(SPRING 1980-81 ADMINISTRATIONS) 









Reading 






Mathematics 








Grade* 


AVl- 


-Sample 


CAT78 


Al 1 -Sample 


CAT/8 






H 1 


Mean 


N 


Mean 


N 


Mean 


N 


nean 






Three 

^ / 
Four ; / 

■ / 


i - 

/886 


.48.16 


201 


4*6.68 


882 


48,01 


s 

204 


46.57 






f 

963 


47.41 


337 


45.35 s 


958 


47,88 


340 : ~ 


45.92 






// 

Five // 




844 


48,31 


cc.0 


yf £ JQ 


1 


48 32 


226 


46.89 






six ' - 


825 


46.74 


COO 






47.08 


259 


47.76 






Seven 


883 


46.92 


317 


/ 

47.09 


881 


' 46.74 


322 


47.48 






Eight 


564 


47.10 


163 


46.40 


532 


47.19 


162 


47,. 52 






Nine 


496 


46. m 


r 
177 


45.73 


484 


47.02 


176 


47.68 

\ 
f 


- 


\ 

1 


Ten 


456 


45.11 




45.73 


456 


46.54 


161 


! 

46.80 






Eleven 


378 


44.94 


1 — 


43.87 


374 


45.23 


130 


i 






All Grades 


6.302 


46.73 


1,974 


45. 90 


6.222 . 


46.38 


1,980. 


46.86 






Note i The focus 
1981-82; 
therefore 


of this evaluation was on those students 
the achievement data were from the spring 
were for the same students when they were 


In grades 4 through 12 in 
1981 administrations and 
in grades 3 through, 11. 
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Table 4-3 displays comparisons by socioeconomic status of T-seore means for 
reading and mathematics, both based on all tests and on solely the 1978 / 
California Achievement Test. Less than two T-score points separates pairs of • 
score means for the same socioeconomic status level. No test conversion bias 
was therefore apparent from these comparisons. J 



TABLE 4-3 



THE ALL-SAMPLE AND THE 1978 VERSION 
✓ OF THE CALIFORNIA ACHIEVEMENT TEST ( CAT78) SAMPLE READING 
AND MATHEMATICS T SCORE MEANS, BY SOCIOECONOMIC STATUS 
(1980-81 ADMINISTRATIONS) 



v Socio- Reading Mathematics 

-economic - All-Sample All-Sample .... CAT75 : 

Status N Mean N Wean N Mean - N Mean 

Receiving free/ ' - • _ 
subsidized lunch 

("low") 3,234 45,84 873 44,29' . 3,233 45-77 873 46-01 
Not receiving 

free/subsidized ■ 

lunch ("hiqh IB ) 1,644 48-94 . 402 47,50 1,646 47,83 402 47,68 



Both Levels 4,878 46,89 1,275 45,30 4,879 46,46 1,275 46.54 : 



Note: Reading scores differed sfgf>if icantly at the ,001 level in both the 

All -Sample and the CAT78 data sets; the mathematics level was significant 
at .001 for the ATl^Sample and at ,01 for the CAT78 data. 



In summary, the scope of this evaluation did not provide for extensive % 
research to be conducted on the underlying differences among tests, nor on , 
the psychometric adequacy of the transformation procedures. Nevertheless, 
Development Associates was able to perform three sets of analyses to discover 
whether there were apparent differences among tes^s, and whether Indian ^ 
students in the sample differed dramatically from their school district 
peers*, These results of these analysis did not show any consistent pattern 
of biases in tests or in transformation procedures, 
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Analytic Methodology 

The methodology used to analyze differences in achievement test scores 
consisted of two phases* descriptive and explanatory , 

The descriptive phase consisted of preparing summary statistics* such as 
means, standard deviations* percentages, etc,, for the reading and 
mathematics scores* now converted to a T-score format, and for several 
project-level and student-level variaoles. This helped "to determine the 
distribution of the scores and how various factors Interrelated. Thus their 
overall usefulness for subsequently analyzing achievement measures could be 
gauged* 

The explanatory phase of, the analyses focused on testing a series of 
hypotheses to determine: (a) what factors- were 4 most related to academic 
performahce and (b) to what extent was Part A Program participation associated 
with standardized achievement test scores; The variables used as predictors 
of reading and mathematics test scores are listed in Table 4-4, 

Two units of analysis were used to test these hypptheses : student-level and 
project^level . That is, the analytic approach first dealt with detecting m 
what student-level factors and 'contextual or programmatic variables might be -. 
associated with differences in test 'scores of Indian and Alaska Native 
students, The project-levAl analyses were based on aggregated student scores 
and focused on determining whether test score differences existed across 
groups bf projects and were associated with project characteristics, 
projjramnatic emphases, or certain types of students more prevalent in some 
projects than In others. 

The primary analytic approach used was on the general linear model (.PROC GLM, 
as contained in the "SAS computer package, SAS Institute, 1979), This • 
approach uses the principle of leasTsquares to fit linear models and was 
considered appropriate s Thee the descriptive phase of the analyses clearly 
indicated extensive numbers of d 1 sproport 1 on ate-s i zed comparison groups, 
These would- have produced misleading estimates^ of between-group differences 
if usual analysis of variance techniques had been used, whereas the GLM 
procedure could more readily and accurately handle 'unbalanced data sets.. 
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TABLE 4-4 

VARIABLES USED AS PREDICTORS OF STUDENT AND PROJECT-LEVEL DIFFERENCES IN 
READING AND MATHEMATICS ACHIEVEMENT TEST SCORES 



Contextual Variables 

♦Technical Assistance Center Geographic Region (S categories) 

♦Number of Indian students In project (5 categories) - 

* Geographic location of project (on or near Reservation, other rural area, 

urban area, metropolitan area) 
♦Proportion of Indians to total students in district (4 categories) 
♦Whether or not Indians, in projects represented a single tribe 



Program Characteristics 

♦Cultural Emphasis (yes, no) 

♦Counseling Emphasis (yes, no) 

♦Basic Academic Skills Emphasis (yes, no) 



Student Characteristics 

♦Language Spoken at Home : English only, Indian language only, both English 
, and an Indian language, another combination of languages 
♦Receiving Free or Partially Free Lunch (SES measure) 
'* Sex 

Grade ' 
♦Tutorial Emphasis in'Reading: none, remedial, or enrichment 
♦Tutorial Emphasis in Mathematics: none, remedial, or enrichment 



♦Also used to test project-level differences- 
Note: For student-level analyses, actual information on each student was used, 

such as grade level; for project-level analyses, it was averaged across 

students In each project, 3 



A series of model-building terms was therefore Included in each statistical 
test conducted with student-level achievement data. These usually Included: 
the variables that were part of the hypothesis as main effects, certain- 
specified interaction terms (which were known to have sufficient numbers of 
cases and cell combinati ons so that the int er act ioh could be estimated), and 
three variables which served as covariates. These three variables were 
. included so that the effects of participant-nonpartlclpant differences in 
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demographic and contextual characteristics could be controlled for, and thus 
be ruled out as a plausible rival hypothesis for test scores differing across 
groups. The three variables on which participants and non-participants most 
differed werei geographic region (represented by the five Technical 
Assistance Center categories), home language , and grade level . These were 
entered into the model as interaction terms (rather than main effects) since 
the proportion of participants and non-participants had differed on each. 
The analytic procedure used these interaction terms as classification factors 
in dummy variable format* Since these covariates were included In the 
analytic model, Type IV sums of squares were Interpreted* so that the 
relationship of each main effect and Interaction with the dependent measures 
would be adjusted for all other sources of variation, Including covariates. 
(This has been considered the preferable approach In dealing with unequal and 
disproportionate comparison group sizes; Specter, 1980,) 

A multivariate analytic model was used* Initial analyses indicated that 
reading and mathematics scores were moderately correlated (.55 at the grade 
4-6 level and .61 at the grade 7-12 level), It therefore seemed sensible to 
Incorporate the correlation between dependent measures into the analysis. 
Findings were analyzed further when the multivariate F-ratio was 
statistically significant, When this occurred, the pattern of findings for 
each dependent measure was also examined to understand which of the two 
dependent measures (reading or mathematics) might have a greater relationship 
with the Independent variables and their interactions. 

In addition to using statistical significance as a criterion forjudging 
whether certain predictors were related to dependent measures, two other 
criteria were used, this was a necessity, since the large number of cases 
used in the analysis made it likely that rather small differences between 
cell means could become statistically significant, However* such differences 
would be unlikely to have practical or programmatic significance for future 
Title IV programming, Therefore, the analysis also examined: 

9 The pattern of least-squares means (i.e*, cell means adjusted for the 
unbalanced and unequal number of cases per cell) so that relevant 
interactions and/or main effects and their direction were clear; and 
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• The proportion of explained variance (based on the multivariate analogue of 
Hayes* omega squared, a measure developed by Sacheva, 1 968) . * Since 8 
using such measures can overlook the importance of the obtained difference 
to the subject area being Investigated and the Instructional intentions of 
the program (Q'Grady, 1982; Porter eit , 1978), the study a-Jso used the 
magnitude of the difference between least square cell means, A difference 
of greater than 3 T-score points, or approximately 1/3 of a standard 
deviation of the ful 1 t sample* s score* was used as a meaningful measure of 
. . effect size*- 6 . .. . . . _ .. ... 



Two sets of analyses wereHconducted with student-level and project-level 
data, One set included students in grades 4-6 and the other students in 
grades .7-1 2. These educational ranges were considered sufficiently distinct; 
they received different attltudinal instruments and were usually separately 
analyzed throughout the evaluation study. Doing so here further controlled 
for between-grade differences between participants and non-participants which 
might have confounded findings* It also represented a form of replication 
across the two sets of analyses so that significant findings found in both 
analyses strengthened the meaningf ulness of the results. 



5 The formula for this is: Omega-squared = r [(N ; x L)/(N - K + L)] where N - 
the total number of students, L * Wilfcs* Lambda Criterion, and K m the number of 
comparison groups (Sacheva, 1968), 

Sin the present study, greater than 5% of explained variance was considered 
meaningful, although admittedly such considerations as: how much variance could 
be explained by a particular relationship, the precision of the significance 
test, and the number of groups being compared, tended to mediate the 
determination of how strong an effect actually was present. . (See Sechrest and 
Yeaton, 1982, for a thoughtful discussion of this Issue* which has policy-making 

^ifflfi44ea»ioa^ ) — : — ■ — — : — _— - - . - _- ^ — 
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Analyses similar- to those for the student level were conducted with 

project-level data. The latter analyses consisted of using either student 

data aggregated to~tne project level or information that already represented 
project descriptors. To ensure that project means were based on a reliable 
number of rases pet^ project, any project having fewer than 10 students with 
test scores was excluded from both the 4-6 and 7-12 student data base 
~ ~ analyses;" ^ 

included in the project level analyses. This excluded only 4,1%, or 133, of 
the grade 4-6 students, and 1.8%, or SO, of the grade 7-12 students. Only a 
small proportion of sampled students was thus excluded from the project-level 

analyses. 

C. Character istics of Test Scores • 



The findings in this study are based on test scores gathered on 6,425 
students in grades 3 through 11 In the spring of 1981, The reading and 
mathematics standardized achievement test scores come from 13 tests and 10 
forms or levels of those tests, representing a total of 23 sources of test 
scores. Table 4-5 Indicates that the lt,d edition of the California 



Achievement Test (CAT) was the test most often administered, to 32% of Indian 
and Alaska Native students who were part of the evaluation sample. The 1978 
edition of the Science Research Associates (SRA) test was administered to 
21%, followed by the 1973 Stanford Achievement Test (SAT), which was used 
with 14%, and the 1973 Comprehensive^Tjlt of Basic Skills (CTBS), used with 
10% of the evaluation sample. Together, these tests were used with over 
three-quarters (76%) of the evaluation sample. 



Table 4-6 contains summary statistics on the test scores obtained. Both 
reading and mathematics mean scores were approximately 2.8 T-score points 
below the national mean of SO, based on converting scores from all tests to 
that standardized T-score format, This corresponds to study test scores . 
being .3 of a standard deviation below the national level (since T-scores 
ha ve a standard davlafcion of 10 points). Related to this, the stand ard 
deviations of the scores obtained in this study were slightly less than the 
national level of 10 points; both reading and mathema' ics scores had" standard 
deviations Of 9.5. 

: . 85 
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TABLE 4-5 

READING A ND MATHEMATICS TESTS INCLUDED IN STUDY 
Test , No, of Students Percentage 



# 



1970 CAT 


30 


0,5 


1978 CAT 


2,006 


31,6 


CTBS-K FORM . 


37 


0.6 


1968 CTBS 




1 ,0 


1973 CTBS 


650 


10.2 


1975 CTBS 


105 


. 1.7 


-196S-GATES-MaeG IN1TIE- 


20 


0.3 


1978 GATIS-MacSINITIE 


6 


0.1 


1971 ITBS 


159 


2.5 


1978 ITBS 


376 


5,9 


1970 MAT ' 


163 


2.6 


1978 MAT 


268 


4.2 


1979 STEP . 


1 


0.0 


1971 SRA 


8 


0.1 


1978 SRA 


1 ,323 


20,8 


1973 SAT 


870 


13.7 


'1965 WRAT 


2 


0,0 


1978 WRAT 


39 


0.6 


1972 TASK 

t 


105 


1.7 


198^ TASK 


15 


0.2 


1978 ITED 


22 


0,3 


1981 ITED 


63 


1 .0 


1976 METROPOLITAN 


26 


0.4 


Name of Test Unknown 


70 





% 



Total . 6,425 e , 00.0 
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The grade level distribution of students has previously been presented in 
Table 4-2, That table indicates that each of the grades 3 through 11 
supplied 6% or more of the data. Each grade supplied between 382 and 969 
cases. As such, all grades were well -represented in the pattern of data, 
although the percentage of students in grades 8 through 11 decreased 
steadily. This simply may be because districts focus more on their testing 

program efforts On the *1gffignt.*yy anrl mirtHI^ qrhnnl grades. 



- TABLE 4-6 

CHARACTERISTICS OF READING AND MATHEMATICS ACHIEVEMENT TEST 
SCORES CONVERTED TO T-SCORE FORMATS 



Characteristics — — — Reading - Mathematics 



a. Mean 47,11 47, &9 

b. Standard deviation 9.49 9,46 

c. Range 4-86 6-87 

d, Mode . 44.00 46,00 

e, ZSth percentile 40,00 40,00 

f. Median (SOth percentile) 46,84 4.6,67 

g, 75th percentile - 54,00 53,00 

h, Number of students 6,374 6,293 



Table 4-7 presents this distribution for reading and mathematics test scores 
In terms of the number of standard deviations (tfr 10-point intervals) above 
and below the national mean of SO, The table Indicates that in the area of 
reading, 3.4% of American Indian and Alaska Natives are exactly at the 
national level (T-score 50), while 37-4% are above that 1 eve 1 9 and 59.-2 are 
below that level. Similarly, in mathematics, 4,3% are at the national level, 
34.6% are above it, and 61.1% are below it. Slightly over 97% of Indian 
student scores fall within the range of +2 standard deviations from the 
populat1on-4nean. This is very similar to the normal distribution result of 
95% of the population's scores falling within that range* It therefore 
appears that the academic performance of Indian and Alaska Native students, in 
-read j#g^ and mathematics -1 -s— lowei^than- .that--af» *1 .1 student*; in puhl in school 
settings, but distributed In approximately^ the same manner, k. 
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TABLE 4-7 



DISTRIBUTION OF READING AND MATHEMATICS 
STANDARDIZED ACHIEVEMENT SCORES AMONG INDIAN STUDENTS 
BY STANDARD DEVIATION RANGE 



Standard Deviation Distance 
From Mean Score of 50; 
Score Range in T-Scores 


Reading Test Mathematics 
Scores Scores 


— More than 4 S.D. beA^^an=4g-94— - 


0.08% 


0.06% 


4 S.D, or less below mean (10-19) 


0.28 \ 


0.13 


3 S.D. or less below mean (20-29) 


1.71 \ 


^ 1 .26 


2 S.D. or lesf"below mean (30-39) 


20.10 


1 20.42 


1 S.D. or less below mean (40-49) 


37.05 


| • . 39.31 ' 


At national mean level (50) 


3.36 


4:26 


1 S.D. or less above mean (51-59) 


27.47 


23.15 


2 S.D. or less above mean (60-69) 


9:40 


10.49 


.3 S.D. or less above mean (70-79) 


0.52 


0.78 


More than 3 S.D. above mean (80-87) 


0.03 


0.14 


TOTAL SCORIS (100%) 


6374 - 


6293 



* 
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Factors Associated with Academic Performance 

A series of' linear model multivariate analyses was conducted to determine if 
certain types of project contextual characteristics, project characteristics, 
program variables, and student characteristics were associated with student 
reading and mathematics scores. Two sets of analyses were conducted, those 
for si-M^Ants in grades 4-6 or 7-12 during th e study year (i.e., grades 3-5 or 
6-11 in the year the tests were administered), A similar pair of analyses 
was conducted at the project level by aggregating student data in those 
projects. Additional analyses were conducted at the student level by using 
bivariate correlation coefficients to determine which of ,a series of 
attitudir.al measures was related to either reading or mathematics test scores. 



The overall conclus ion from conducting these analyses was that virtually dll\ 
of the factors hypothesized as having a relationship with achievement g> ■ 

(including program participation) were not related to academic performance jjj^H 
any meaningful way, either at the student or project level. Some relation-^- 
ships were statistically significant, an expected finding in view of the 
large number of cases present at each set of grades. However, the reiat1o|- , 
ships found were not strong ones, and comparison groups did not differ widj| 
from each other in terms of actual test score differences. 

ft* 

A discussion of the specific findings is presented below. 




Project Contextual Factors and Student Academic Performance 

These analyses checked if any of the following contextual factors were 
ilgnlf+cMiHy and meaningful ly related to students 1 reading and mathemafl^j 
levels: •' * * 

• The number of Indfans In the school district; 

\ . it 

• Whether one or mere tribes were represented by the Indian students in^the 
project (a measure of tribal homogeneity); and , 

T The geographic region of the Title IV Technical Assistance^Center in which 
the project was located. - -Sq 
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Analyses were conducted for these main effects. Certain Interactions were 
also tested when it was considered important and wnen there was variation on 
each factor so that interaction effects could be tested, 

Format erf Statistical Tables , . Tnese findings are presented in Table 4-8, 
which has a format common to other tables which will be subsequently 
discussed. Table 4-8 contains: the hypothesized source of variation in test 
scores, the degrees of freedom and multivariate F-ratio, the profraDility^ 
level of obtaining the corresponding F-ratio, and the proportion of explained 
variance (i.e., omega-squared) resulting from testing for a relationship 
between a particular source of variation and the two dependent measures of - 
reading and mathematics %cor%»< Since parallel analyses were conducted for 
the grade 4-6 students" and 7-12 "students (i.e, s students in, those grades 

educing ^h€_jexaIuatT(On_school year of 1981), these two sets of analyse s are 

presented side-by-side. 

The first three sources of variation In tne general multivariate linear model 
■tables of findings represent covariates, That is, they represent certain 

differences between program participants and non-participants which were,* 

controlled for by including them in the analysis. These covariates are then 
.followed by main effects and interactions that were part of testing the 

hypotheses. 

It should be noted that although each of these statistical tables contains 
three sources of variance relating program participation to academic 
performance* these factos were not included in the particular analyses to 
assess program participation per se. Rather, these factors were included in 
most analyses as covariates', as just explained, Table 4-9 and the . 
relationships it includes provides the strongest basis for determining If 
■ pVogram participation was, significantly and meaningfully rejlated to student 
test scores. . 

t * 

It should also be noted that 3,280 students nn grades 4-6. and 4,364 students . 
in grades 7-12 provided attitudinal , achievement, and/or attendance 
information. However, the analyses being reported here had .amples sizes 
approximately three-fifths that size. This is because the multivariate ' 
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analyses called for complete data on all variables, --and thus cases without 
complete data were dropped from the analyses* As described earlier* this 
procedure introduced no apparent biases into the student data* 

Results , Table 4-8 indicates that the three covariates used were 
statistically significant and therefore contributed to Improving the quality 
of testing the hypotheses of Interest* However, they only explained a very 
small amount of variation in test scores* This was "true for bat h the ~ 
elementary and the middle/high school results. All other interactions and 
main effects were statistically significant for both grade ranges, except for 
the interaction of TAC region and tribal homogeneity among students within a 
particular project, which was non-significant for 7-12 grade students* 
Although statistically significant, none of the interactions and main effects 
ex plained any meaningf ul amou nt of variation in test scores ( i . e , , 2*1% o r 



less), except for the Interaction of the TAC region and the number of Indian % 
students found, in projects in particular regions, About five to six percent 
of explained variance was found by using that source of variation, depending 
on which grade range of students was involved* The pattern of findings when 
only considering reading or mathematics test scores is very similar to that 
from using both measures of academic performance* and is # not presented 
separately here* (For example, the univariate F-ratios associated with 
reading scores, independent of mathematics scores being predicted from the 
interaction of TAC region and the number of Indian students in each project, 
was 6,28 and 5*81 for each grade range, respectively. The multivariate 
F-ratios were approximately 6,35 for each grade range,) 

It thus appears that academic performance of Indian students was unrelated to 
contextual factors such as the number of Indians, TAC region, and tribal 
homogeneity of the projects that served them, 

Project Characteristics a nd Academic Performance 

_ — y — — 

Table 4-9 presents statistical tests on whether or not student reading and 
mathematics scores were related to project geographic -location and the 



proportion of Indian students In the total student body. The home language 
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GENERAL LINEAR MQEL PUTIVARtATE KSULTS RELATIHG PROJICT COHTEKW CHARACTERISTICS 
TO READING AMD MATHEMATICS SCORES IN GRADES 4-6 AND 7-12 



/ , A. Grades 4-6 


8, Grades 7-1 


Source of Variation 
/ 


Degrees 

of 
Frifdca* 


KiHIvarliti 
r*naiio 


P 


Cj-vi t i ran 


Degrees 
of 
Freedgffl* 


MtlHrliti 




i 












IA£ Region X Partleipatftn 


16,4072 


2,06 


.008 


,001 


8,4822 


2,4* 


Hone Language i Participation 


18,4072 


3,12 

1 


,000 


,024 


12,4822 


5.09 


Grade K Participation/ 


12,4072 


2,49 


,003 


,012 


20,4822 


2.54 


Number of Indians 


8,40)2 


2,68 


,006 


,009 


8,4822 s 


2.58 


Tribal Hougenelty 


2,2036 


10,96 


,000 


.010 


2,2411 


4.78 ~ 


TAC Region 


8,4071 


6.01 


.000 


,021 


8,4822 


1,96 


Nwber of Indians X Tribal Homogeneity 


4,^072 


ti irt 

8.10 


,000 


nil 

,011 




\ si 


TAC Region I Nunber of Indians 


24,4072 


6,46 


.000 


.066 


24,4322 


6.35 


TAC Region It Tribal (toagpiity 


.. 2,2036 


4,94 


,007 


.000 


2,2411 


1.24 



p 



,013 
,000 



,048 
.004 
,000 



"Baled on Hllki' Lanbda Criterion. 
"Not com uted sinei p > ,05 (non»signjf leant j. 
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TABLE 4-9 



GENERAL Lip HOOEL NJlffVARlATE RESULTS KLATIK PRWfCT CWRACTERISTICS 
^JO WADING AND HATHIHAT1CS SCORES IN GRADES 4=6 AHD 7-12 ' 



A, Grades 



Sourci of Variation 

t 


Agrees 

of 
fniddi* 


HultlvaHate 

nyiviiBi tali 

Mitio* 


P 


Squared 


Degrees 

af 
Fnidooi* 


Hultivariati 

■ PHI El in* 

F-Ritio* 


P 


Osegai 
Squired 


Tlf Don Inn 1 DirHrlhlHrtn 

Inw Region A fflrutipatiQn 






000 




Ii ikl 

ly if f Ofe 


4.49 


,000 
s 


.026 


Hok Language X Participation 


12,4040 


u? 


,067 


ii 


6,4782 


0.92 


.471 


? . 


Grids X Participation 


12,4040 


2,17 


,011 


,009 


20,4762 


2.46 


.000 


,000 


Project Location 


6,4040 


2.18 


,042 


.001 


6,4782 


2.34 


.021 


,006 


Density 


6,4040 


1%69 


.120 


■ ii 


6,4782 


0,93 


.'474 


it 


Hm Language 1 Project Location 


13,4040 


1,43 


.105 


ft* 


16,4782 


0,54 


.939 


i 


Hue Language X Density 


18,404^ 


m 


.974 


ft* 


,18,4782 


1.16 


.289 , 


it 


Project Location I Density 


12,4040 


1.65 


.071 


it 


12,4782, 


0,69 




i* 


Hon Language I Project Location I Density 


18,4040, 


1,01 


.441 


it 


^4,4782 


0,33 


,999 


ii 



S, Grades 7-12 (H 



%sed on tjllks' Unbda Criterion, 
**Not coHputid iince p>.05 (non-significant). 
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of stLdents also was Included In the statistical analysis* to control, for the 
possibility that Indian students might use English predominantly at home, 
depending on project location or the proportion of Indian students, 



Findings indicate 'that none of ther hypothesized factors were' meaningful ly. 
related to patterns of academic 'performance* either at the 4-6 or 7-12 grade 
ranges, \ after control ling for paft1cipant-nonpart1cipant differences in three 
characteristics* the, location fif projects (either on or near ^ reservation, 
other rural area, urban area, or metroftolitah area) was the only -variable 
that was Statistically signif/cant. Hoover, the proportion of explained 

iect 



variation !n test scores w^s/only ,005 for each of the grade ranges, 
location, was statistically Related to reading scores but not to mathematics 
scores in th^ grade 4-6 analysis; the reverse was true In the -grade 7-12 
analysis* However, In each of these sets of analysis, the spread of test 
score means wak less than/3 T-score points, the criterion used as a measure 
of effect size. 



In essenpe, the finding^ Indicate that the project characteristics of project 
location and* proportion/ of Indian students In the projec w were unrelated to 

acadfemic performance, / Inclusion of student home language as a control . - 

■ -.?/.*=* * • 

variable for the hypothesized. relationship of these two project 
characteristics with student test scores made no difference. 

Local Program Emphasjes and.Academlq Performance 

" ■ J " " \ A < * 

This phase of the ahalyses focusad on "establishing whether Title IV programs 
with certain features were relatively rgore likely to also have, Indi^ and 
Alaska Native Students with hlgherreading and mathematics test scores. The 
program features included in the analyses were: 



• Presence of 'a cultural prograrft; 

• Presence of a /counseling program; and i 

» Presence of ah academl c component ; hav ing\ either : (a) a basic acaderrflc 
skills emphasis of Increasing student" abj 11 ties in reading, mathematics,.^ 
language arts, or (b) a[ftvem^hasis on improving 'students 1 abilities to \ 
comnunlcate fln the English languages • . .: %,--.\- r : 
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^Whether these factors were* Independently or jointly related to student test. , 
• ■seo'res were 'included in the analytical model for both .grade, ranges. Thus, 
programs having both a cultural and a. basic" skills emphasis were included' for 
analytic purposes, and data* from stents 1n luch projects could be- compared - 
with students In projects having only one of these emphases. Findings are 

- presented in Table 4-1Q. For the most part, statistically •significant 

- relationships were found for each grade range, but the findings did not 

' reflect practical and meaningful relationships. • • . * 



Certain Interactions 7 were statistically significant at. the .4-6 grade • » ™- 

-.range f and not at the 7-12 grade range. This represented the following 

if actors: culture and eaunsellng components, and culture and academic skiTls. ^ 



The pattern ^f. least squares means for student data* relative to the types pf^ 
projects they were 1n» was the following: A 



Culture 

No) program 
No] program 

Progpam 
Program . 



Counseling 

No program 
V Program 

No program 
Program 




Mea** 
*Rea 

44. Si 
44.78 

46.52^ 
47.54 



Mean 
. Mathematics 

,..„ 49.85 
46.18 



- 47.55 
f 48.31 



■ V 1 



IS 

M 



Thus, students In projects-having both cultural and I counseling |ofppnents h^g| 
the highest reading scores. Students In projects with neither component had 3| 
the highest mathematics scores./ These differences ^r^somewhat difficult to; 3 3 
Interpret. " 




>FW interpretation purposes, significant interaction effec^ are^usually^tje 
focus since main effects need to be qualified If both are significant lv *~* 

1968). : 
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'minim mi mmirn results elating pwsbah mmmm 

; TO READING WD MATHEMATICS SCORES IN SHADES 4^1 MD H2 , 



A. Grades M 



— — r- 

Source of Virlatlen 



TAG Region K Partfclpatfon 
flam UngHigi Xfartieipitioh 
Gride X Partletpatlon • 
'Culture - 



Cjilture t Counsel Ing 

i i 

Culture I Belles 
Counseling K Basics 

■ i 

Culture K Counseling K Bastes 



,1 




fUHfviriil 
F*Ratio» 



1.46 



B, Grades Ml (HW) 



if 



Hultlvariat 

Mlatlo* 



,000 



.219 



Squared 



y Hotei p < .Oimstatf stkal significance* 
/ *tased £ti W11ks a UiWa CritiHon, 
"Hot eosputftf since p^OS (nsn^ipifeanlj, 



o 8o 
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The least squares "w^ns b>r*a ry,; ^ presence of cultural and ba$j£ 4 academic 



ski l is project efmnfr??^ 



*s f y lows: 



Cultural 

No program 

No program. 

f 

Program 
Program 



NO pfi DgrJMfi 

to f*rof^rant 



Mean 
Reading 

44,25 
45.04 

48.34 

46,72 



Ptean > 
Mathematics 

48.36 

, 47,66 V 

shoo * ■■. 

44187* 



Students in^pradee" rifting a cultural program But ho academic pfogram had 
the highest scwes in. feoth reading and mathematics. * These data *appear^to 
suggest that-^rojects having students who need less academic help are more 
likely to focus on cultural programs, H 

Program- Participation and: Academic levels 



One quite importir^ aspect of the study was to determine If test score levels ?^ 
were associated with student participation on Part A project activities^: £ One^| 
measure th^t has consistently been shown to be^^ated to ach 
Is "exposure*^ to academic assistance (also Icnown as learning tfmeif^tensl^^S 
of instruction and interaction .* Stal 1 Ings* 1 975; ipnds ft; 
and Harnlschweger* 1 974) ♦ AThe scope and resources of the r present study /d1< 
not permit detailed classj^m observation ^asureme 



approaches to estimating student participation In Part A^onsoredtactlyl 
, Were used i Project personnel were asked to estimated the degrees of pr.ogr ; a 
participation during f >T^0^81 ^or each sti^ent^^l^ftr*ee.: r 



(Iqj?, middle* hlghX^ere defined and; then assoCi 
performance. HfTsVfnfonnatfo^^ 
3,106 (48X) of the 6,425 students having test^f? 



many, school 
participation 



. * * t 




because 





The staff members might have h^dlff Iculties "fitting" the somewhat global 
participation rating scale categories to the actual program activities, 
Participation In * tutoring or gifted and talented program, for example* may 
have been easier to rate tjian participation in cultural activities (including 
some in which aCTeiWancr^ll^^ 

w * ■ * , • . ■ 

Analyses of variance results tdid not Indicate that participation levels as 
described by staff ware significantly associated with either reading or _ V 
maternities test scores,' In. fact, .less than one T-score point separated mean/ 
scores\for the three levels of participation. ^ , 

Another appWach to determine the degree of participation was to, categorize 
students based on their pattern of answers to five questions administered to 
them during ^he sprjng 1982 data col fectlon period,. These questions dealt - 
with Whether or\net studentsftad participated in program activities (field * 
trips, potlueks, museums \ ceremonies, games, or tournaments), had received 
;utoring insbtuctibn or ^counseling, or had had other forms of contact with 
local Indian education project •personnel. On the basis of these questions, 
students in grades 4-6 were categorized Into those who had not received 
project services in 1980-81, those who werjt In their" first year or more of * 
receiving services, and those who were unsure of their status. Students In 
grades 7-12, were categorized Into similar groups, although, due to the grade 
raftge involved, students were more readily able to supply, clear-cut responses 
on participation, and no "unsure" category was used ^ ^ * • 

Table 4-10 indicates that each of the three variables^ 
with-flartlcipatlpn (TAC Region, Home Language, and ■Grade L#veT)^wa$. ;• ■ 
statistically related to reading and mathematics scores,; fbn.:'e'acl*?S?-.t'hi»^tW---;; 
grade ranges. However, no more than 3.4% of variance "of these Scopes was 
explained, thus Indicating fairly weak relationships. Thus, it d1^ hot 
appear that program participation, as defined In these analyses, was ? major. 



ci pa 
ern/ 



factor affedtihg the pattern(of test scores. 

Th1s*pattern wis also indicated by the mean scores for the^groups being 

compared. For example, with i ^esgect tp the statistically significant home 

'.-•>'• • ■ •*/•-«•"••-*'> • •>• ... j 
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language by participation Interaction which was found, .the pattern of* mean 
scores for 7-12 students Jthe larger of; the two effects) was the following; 



Language 
Used at Hpme 

English only 

* 

Indian only 



Both- Engl ish 
and Indian & 

Other languages 



Participation 
^Status 

Not in program 
First year or more 

Not in program \ 
First year or more 

in program 
First year or more 

Hot in program 
First year or more 



Mean 


Mean 


Reading 


Mathematics 


47.06* 


48. U*' 


46. 40 


4S.27; , 


40.34 ~ , 


43.67 


39.61 


' OW 41.20 


44.05 


\ 47.16 


44.43 


' 45.49 


45.23 \ 


47.25 


46.56 ' 


45,33^ ^/\ : 



0 . tt - *♦ . * ...... fl 

Th^pattern of least squares means J ndi cat es that 7*12 jtudent^uslng ^on^^:^ 
English at home had the highest scores* and* those stuuents using only Indian 
languages at home had the lowest scored. Furthermore* In five of the eight 
comparison groups* 7-12 students not in the program had higher mean sc!bres_ 
than those in the ^rpgram f bf^one or more^years • 'This may ifidicate that Part ft 
A projects art more likely to%e, working with" students* who require academic ' | 
assistance* ' • m ' ' :/'':*?m 



Student Characteristics and Academic fterfoWnance 



This analysis used tlje three covar*1ates of T£C Region, 
Grade Level to control for .partic1pat1on-nonpart1c1pat1on differences, and 
tmt^ fmyih^hBr Or hot students'- age- v sex. or grade were significantly 

As with other analyses,*" the i three cdva^lates were effective and related: to ll 
reading, and mathematics scores . * However, the factors |elng^tested--we^e| 
• 'alwi^S^S^-iaVtiy rtlated.^More. specifically,; sex. Wa* 'not' related.] ^ 
scores 1n e1th< 
but^ not: in grades 



ier gr*ade fange : Age lias re 1 ated to test scores tfn grades^® 
ides -7*12 - . --' y ' :\ ' - \ --- ■ '* . i ■ > • ■ - \ ^ ^\f^ 
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GENERAL LINEAR MM MULTIVARIATE RESULTS REUTINK SWOT CHARACTERISTICS 

to RWDiiiuio mmm scores in grades 4-s m ui 



i 



1 9 



L Grades 4-6* <N-2090) 



/' 



Source of Variation * 

' ■ /" ■■" ■ 


Degreti 
of 
Freedon* 


tolii- 

vifiatt 

Nlatio*' 


f i 


Ofega* 

•Squired 


E 

'Degrees 
ef 

Freedafc* 


varlite 
F-Ratlo* 




0*ega- 

. Squ*re<l 


TAC Region X Participation - » , 


i 

24 .4100 


\ Ml 


/ 

' ,000. 


; m 


j 16,4820 


; ■■■ ' } 

3,36 ; , 


,000 7 


si'" • I' .!t,\ '. 

\018 


( T " Home Language X Participation 


18,4100 


' 3.42 

*. • 


' , 000 


.025 


12,4820' 


4.63 


■ / 

.000 


' .KIT 


, Grade I Participation 


8,4100 


ZJO 


*oo§ •', 


/.titt 


10,4820 


2.49 




: . s ?i : : ''; ■ 




6,4100 


3.51 


.010 


,.010 


12,4820 


1.0K 


' .434 




'.'to* 1 : ' 


. * 

2,1050 


1.39 


' / 


: m 


2,2410 < 


in 


.114 


' 


/ \ Grade 


4,4100 


i in 


'.op 


M 


10,4820 


0*70 


.?» 


, 1 -I, 1 ' 1 : ! 


•"" Grade X Age ,' • 


10,4100 


2.07 

i / ' 


,024 

* ■ 


M 


32,4820 


1.24 




" ». '• i v - 




' *Ba$ed on Wlks 1 Laatda CrItsriM. » 
k **Not eoflrputid jlnce p >. 05 inon-signlf leant). 



.'■/ 



f 




• ... \- ... ' , •! ..: V. .' ...v?/ A 



: / 



ERIC 



The grade by age interaction and the main effect of grade were related to 
test scores In gnades 4-£ f but not In grades 7-12. This factor has received 
special attention in the literature. Reyiefws of the literature have 
suggested that in recent years, the academic performance of Indian elementary 
pupils was near the norm but that a decline in scores, when compared with the 
norm, occurred roughly progressively thereafter. The . pattern found i o the 
present evaluation (see. the All -Sample means for reading and mathematics, in 
Table 4-2 presented earlier) indicates the existence of such a decline. Thee 
third graders 1 means were slightly over 48 (the norm is 50) for both reading 
and mathematics; the eleventh graders 1 means were" 44. 94 for reading and 45.23 
for mathematics.* ^ /< t - . a\ •• 

' " - «* ■ . \ ■ *./•'■'■' ' r ? 

The reading T-score mean for all the stujents In grades* 3-W was 47.11 and ^ 
for mathematics was 47*29. These are less than three points beldw jhe ndr^ ; f 
of SO* 1"he$e are not substantially different from trie means reported in tM|| 
data from those reported for California (1981) arjd North Carolina (1 981) i nor? 
from some of the districts with large Indian populations such as Oallas % 
(1981), Durant' (1981), and Grand Rapids (1980, 1981). Howeyep, these means }; 
place *the sample above those for the State of Arizona (1981a,. J 981b) , New : 
Mexico (1981), 'and the Bureau of. Indian Affairs schools (BiAV 1981), ; v -; 

In general, the means for all the students 1n this evaluation,, sa^le^were 
similar to those fWmti^tn research and evaluation reports 

for the past three or four years, and were ^ear the norm for the 5.nt1rfi_''-grWg 

As Table 4-11 iridicat^, despite ^he statistical Ty significant relationships;* 
age and grade were not strongly related to academic performance-levels. .,"T«4:^ 
Is, no more than 156 of variance in test scores was_.explalned by either of | & 
these *two student variables.. ." • -v.. *.;;.-. - '\*>- • 




I^vthus: appeals that age^^x^a 

and mathematics scores, especially at the upper grades;, (7 r 12). ; At .thejowe^ 




grades; hp^ 
' th*re: were 
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Soci oeconomi c Status and Academic Performance 



Stucties of achievement ibst differences by socioeconomic status (SES) Jiave „ , * 

* ■» « 

consistently produced significant And usually substantial differences. In 
the state oft California bilingual education evaluation study (Jones et al M - 
1980), for example* thyis was the second most inf 1uential\variable (after 
English fluency) with "low" SES- students scdrings six points lower than other 
students In reading, and five points lower in mathematics. Maye'ske & Beaton , 
(1975) found similar differences among Indian students* In the present 
evaluation, only two SES levels ware included- "low" for thorn certified as. 
eligible for suSndiked.-sehoQl lunch, and "other", for those not eligible (the' 
same, criterion* as used In the California bilingual study and In many other , 
recent studies). .. . • , 

The number of students ;c lass 1 fled as "low" was twice that of those in the 4 v: 
"other 11 pategory,' although no 1 information was available on another quarter of 3 
the students. Nonetheless, that ratio Is substantially largec than that .- 
found in most of the cited studies* ^Jln addition, some schooT personnel 
estimated that the "other" group would predominantly fal linear- the Income ^ 
criterion for subsidized lunch/ If that was true for the sample^ as a whole, : : 
it might account for the somewhat smaller T-score differences fourid^tween ^ % ^ 
the, two groups,, as indicated by the low amounts of expl ai rie(| Variance 
presented in Table 4-12* - : ^ " 

4 ■ . i ' ' ■ - • • ■■f+lX& 

Socioeconomic status was found tm be significantly related to reading and S^^'^J^ 
mathematics scores* However, U^nly accounted for 

in the dependent measures fpi(jach of the two grade rangesS tud1 ed . 4 y 7 * r 



Data Included In the White (1982) extensive>eta-arrj^s1s'# relationships 



between socioeconomic status and academic achievement were used^as a baseline; 
fcoKexamlhlng similar relationships ih the, preMnt study, Tafcilj 4-13 Was f * > ^ 
" developed by using the Coleman et. al. (1966) dattf included^vwe ^ ,. .fi^ 
meta-analysis. In both studies, socioeconomic sta^Ms ; p|nj^ rea^rig; '^^u ^^rf^^M 
mathematics' achievement were related less as g^ade,!^ 

five of the six correl ati Ah coefficients J n the'present .', study^lndlcated, lower ^ : < 
rel at ionships between SES land academic achievement than did ^He Coleman 

..:•....*,• ' — : . * // ; : . .... ,. v - . ■ - - ' 

, : . .:v ; ■.,■.•,-;/■"- . .-. i - • - „ 

/', ' i /\ ' '-- \ , 1 f) O ; > , _ r- . ' . ^ri l -l ■ <^^^i 
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6EHERAL LINEAR MODEL MULTIVARIATE RESULTS RELATING SOCIOECONOMIC STATUS 
. TO READING AND MATHEMATICS SCORES IN OWES H AND 7-12 



X 



A. grades 4-6 



Soyrre of Variation 



TAC Region X 



pation 



Grade J| Participation 
So€loectnoffl1c Status 



Home 



t x $ Socioeconoraic Status 



Degrees 

of 
FfeedOi* 



24.3266 

i 

12,3266 
12,3166 
2,1633 
6,3266 



Multl- 



146 
1.97 
(.93 
1.01 - 



.000 



.023! 

.001 

.414 



Squirid 



f M 
IV * 

,on 

.008 



B. Grades 7-12 (M927) 



of 



^ 16,3792 
6,3792 
20,3792 ' 
2,1896 
6,3792 



Hulii- 

viriate 

F-Ratlo* 



in 



3.43 
1.54 



.000 
.212 
•.000 
,032 
.159 



Omega* 
Squared 



.023 
.003 , 

MS 



* t 



•Based ©nWilJts' Lambda Criterion^ . 
**itot Eonputed since p >.05 (non-significant). 



/ 



J » 



Y 



study. Th 



4-35 



s may be- because the SES measure used in the ! present , study (fret 



lunch status) Is a less sensitive measure than that used in the Coleman study. 



. , , TABLE- 4-13 V 

RELATIONSHIP BETWEEN GRADE LEVEL AND THE MAGNITUDE OF THE CORRELATION 
/ BETWEEN SOCIOECONOMIC STATUS AND ACADEMIC ACHIEVEMENT 
V~ ( PRESENT STUDY VS. COLEMAN ET AL. , 1966) 



/ 

Comparably/ 
Grade*^/ 


i — - - - 

Readtng 
r 


Present Study 

Mathematics 
r 


Verbal 
Aehlevament 
r 


Coleman 

Math 
Achievement 

r , 




.207 


. .167 


.207 


.209 




.152 


.102 


.176 


.161 „. 


•7 


.128 


.108 

\ 


.175 


.131 



v . relations fo%grade 3 are not compared here because Coleman et aU did not 
se the same SES measure throughout their study; thus the. correlation was not 
reported by White (1982)* ^ * 

/ • ■ ■ . •.. - j ... - - 

Notes: (1) All correlations in the present study were based on 278 or more 
students* ' ^ 

(2) All correlations in the Coleman study were based on 20 students* 
* (3) Sourcai White (1982), 

(4) Coleman et al. reported correlations, for grade 12; the present study 
used grade ~TT *s a proxy * > ■ * * - 

, s / V 
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White (1982) reported from his meta-analysis of 4|9 studies, that SES and : 
achievement were correlated -.243 when correlating that relationship withr- 
grade level* That is, SES and achievement were less related to each other" as 
"grade level Increased. In congas t, the present study /found consistently low 
reading - SES correlations ranging from -159 In gride 3 to * 128 in * grade 11, 
and a similar pattern of mathematics - SES correlations ranging from .102 In 
grade 3 to *108 irt grpde 11-, Both sets of correl at iortst tended to rise untlf 
grade 7 9 when they peaked "(ilfe% 232 for reading and r HU216 for mathematics) ! 



they then declined thereafter. The correlation of reading SES relationships 
with grade level (across grades 3-11} was --443, indicating even mora vividlj 
than White's 1982 meta-analysis finding that SES affects reading even less 
for Indian students as grade level Increases, However, for mathematics, the 
correlation betwen the same two variables was -,0S3, Mathematics and SES 
apparently held the same relationship which was unrelated to grade level 
shifts, 

Tutoring and Academic Performance 

Linear models were developed to determine" if students who did not receive 
tutoring, compared with those .who did receive it for remedial or enrichment 
purposes, had significantly different, levels of test scores, One analysis 
was conducted for students receiving assistance In reading and another 
analysis for those receiving mathematics assistance- Student grade level was - 
also- used, since those receiving assistance in one grade might have been _ 
different from those receiving assistance in another, These analyses were • 
only cc-1ucted for the 7*12 gratis range, The three covariates used In other 
analyses were also used here. - ; * 

Findings indicate very few statistically significant relationships. The 
three\covariates were. not • effective, nor was grade level, either as a main 
effector- as • an -interaction- with reading or mathematics assistance. What was 
significantly related to test scores were the main effects of reading, and 
mathematics assistance, which had identical patterns. Fdn reading, those not 
receiving tutoring had -a mean scqre of 47.00, while those receiving tutoring 
for enrichment purposes were significantly lower (43.62) arid not different 
from those receiving remedial assistance (41.48). For mathematics j.^hesr 
means were 47.36, 45.17, and 43.10, respectively. Those who received \ 
tutoring thus had Tower leveU of academic achievement than those not ^ 
receiving tutoring. 
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Attitudes and Academic Performance 



A serits of bivariate correlation coefficients were computed to determine If 
certain types of attitudinal measures were significantly related to reading 
and mathematics test scores. Table 4-14 Indicates that low, although • 
•statistically significant, relationships were found between students' 
attitude toward school, their perceived value of education, their academic 
self -concept, their global self-esteem, and each of the dependent measures. 
These relationships held for students in grades 4-6 and in grades 7-T2.* 

The strongest relationships were obtained whin correlating academic^ 
self -concept with reading and mathematics scores, as might be expected. 
Relationships at the 7-12 ^rade range wens higher than at the 4-6 level, The 
obtained correlations of reading "and mathematics* scores with either academic 
-self-concept or global self-esteem were loafer than those found in others 
studies (Revlckl, 1982; Bryne and Carlson, 1982; Hansford Ind Hattie, 1982), 
for example, the latter meta-analysis stddy computed an "averse" correlation 
of self-concept of ability with performance/achievement of r tf ,42 (5*0, of 
that correlation.* -22), and ,22 with self-esteem (S.D. = -17). However* the 
present finding that reading and mathematics achievement were more related to 
academic ^elf -concept than to global self-esteem 1$ fully consistent with, the 
causal rno'deling approaches used by Bryne and Carlson to obtain the same 
results, using Canadian secondary school students. 

The only attitudinal measure which wis not significantly related to reading 
or mathematics scores was students. 1 identification with being Indian, The / 
latter scale was found -*n another phase, of this study to actually be part of 
a dimension having three components. Thus, a higher correlation might have 
resulted from using all three components In a multiple regression approach- to 
predict academic levels, X 
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TABLE 4-14 



correlations between attitudinal MEASURES and 

READING AND MATHpATICS OUTCOMES BY GRADE RANGE 





* Grades 4*6 . 
(N^21 29-2202} 


Grades 7-12 ' 
(N=2454-2559) ■ -■ 


Attitude Pleasure 


heading 


rtath 


Reading 


Hath 


Attitude toward school 


.083 


'.055^- 


.057 


.111 


Value of education 


ViSl 


.112 


.199 _ 


.210 


Indian Identification and pride 


.006* 


.039* 


.021* r 


.015 


Academic self -concept 


" .190 


'.200, • 


.354 


.355 r 


Global self-esteem , o 


• .095 


.108 


. .204 


.172 


Mathwiatics 


.555 




.607 


" • iZ'' 



* . ■ 

Notes: (1) "Attitude measures were created for each student -by suimrfng a s^rles^ 
of four point rating Scale Items In which livery nweh agree and ^||g 
4 4-very much disagree, and dividing by tfie number of items to which ^ 
the student responded. Because of the direction of ' »«rt^'»^''■v^^^J 

* attitude-test score correlations have a negative sign which has 

* been dropped in this chapter. # ; . ^ §| 

(2) *=*Not statistically significant (p>,001)t alt other correlatlpni^ 
presented here are statistically significant. ^ ^ 



(3) Correlations are based on slightly varying sample slips f as indi^^ 

(4) Academic self -concept and global self-esteem correlated .392 



forllradeI~4-6 ^^3174) and viol for trades 7-T2 (N*4315) ./'Jir^h 



L'J. . .if.'.: 

3% 
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Project^Level Differences in Academic/ Performance 

A series of analyses was conducted which was similar in style to those for 
student varwbles, and was based on the 47 projects having more than 10 
students, Relatively few of the project-level analyses Indicated 
statistically significant relationships with reading and mathematics scores* 
It appears that most of the- relationships found Between certain factors and 
test scores were "Sue to variations in individual .student levels of academic 
performance, rather than to_ students being served differently by particular 
projects, The following is an overview of the findings tfhich resulted from 
conducting ^linear rode! analyses by grate range, Qsfng student data - 

aggregated to the project level: 

* ■ t ■ ' 

Students in Grades 4-6 

•The nuifiber of Indian students in the project was related to reading but not 
mathematics score differences* across projects ; ^tfi£/4 arger the project In 
terms of the number of Indjans^JJje lowef was ttff mean reading score (the 

• scores ranged from 51 ,5 for the tW&^rojects having 31*99 Indians to 46,2 
for the nine projects having 300-500 Mdlan students), 

• Projects having a cultural emphasis had significantly but not meaningfully 
higher mean student, scores in mathematics than it hose projects which did not 
(48.8 compared to 47.4) . - # 

• Socioeconomic status (SES) did differ across projects, as did the 
proportion of students in each project only using the English language at 
home. SES wis strongly related to academic achievement in the 

. project-level analyses ( appearing for both grade ranges), and^tad an 

omega-sqdaned level of .187. The relative use of English at horns .was even 
more associated with academic performance ,( omega-squared 3 ,229), 

m Grade level was negatively related to academic performance, as the 
student-level analyses also indicated. ' 0 

Students in Srades 7-12 f ^^s^ 

• SES was net significantly related on a multivariate basis to reading am 
mathematics achievement scores. However, SES was significantly related to 

; reading and mathematics outcomes, separately, For reading scores, those 
projects with fewer than 502 of their 7-12 students receiving free or 
subsidized lunches had slightly higher scores than projects with more than 
50^ of their students In a free lunch category (46. 9|^compared to 46,05), 
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a The tribal homogeneity of the students being served was associated with 
project-level differences,, as was the interaction of the numosr of Indians- 
in the project and its tribal homogeneity. Projects serving mare %nan one 
tribe had higher mathematics scores 9 than did projects only serving one 
tribe (50.12 compared to 46,40), 

Conclusions \^ ^ 

The findings presented in this chapter Indicate that Indian students in 
public school districts score below the means on star^rjized-achievement 
tests in reading and mathematics. The Indian mean scores in these subjects 
were less than a third of a standard deviation below the mean, however, 
showing that the dif fiances between Indians and otheA students are not 
dramatic, / - X ' ^ - ^ 

There were no clear fi«d,ings concerning the impact of Part A projects on 
achievement test scores. There was a slight tendency for Indian students who 
had contact with Part A projects to have lower achievement test scores than, 
students who had not participated In /Part A activities, but this finding 
probably Indicates that Part A. projects are more likely- to be working with 
students who require academic assistance. 



In fact, very few of the project or student characteristics which 
studied served as meaningful predictors of Indian student test scores. There 
was \ large number of statistically significant relationships, but few of 
those relationships accounted for meaningful proportions of the variation in 
student scores.- It would thus appear either that; (a) the variables which 
were selected for study 1n this evaluation are not those which are related to 
Indian student achievement test' performance; (b) the'' measurement of those 
variables was Imprecise or Inaccurate; or (c) there are few project or 
Student variables, which are meaningful predictors of Indian student 
achievement test scores. . T 
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There were, however, three findings which appear to have potential program 
implications. 



1) 



2) 



The achievement test scores appeared to decrease slightly with 
increasing grada level, Indlanf students are thus apparently falling 
farther behind tbeir peers as they continue through school. This 
finding would appear to suggest that continuing emphasis should be 
placed on the jwademic achievement levels of Indian students in grades 
6-12. f ■ ' r 

As is true in the general population, Indian achievement test scores 
were corrllaAed with socioeconomic status* The results show that Indian 
students tffyaKreceiveci free or subsidized school lunches scored lower ' 
thaft ^ (rtheKIifdl an students.. A very large percentage (66%) of the Indian 
students for whom data were r ava11abJe received free or subsidized 
lunches. These data illustrate that economic factors are related to the 
lower achievement* levels of 4fld1an students. 




Ther^were significant and meaningful correlations between reading apd 
mathematics achievement tast .scores and a measure of academic 
Iltlf -concepts Several recint studies %Calsyn and Kenny* 1977; Revicfci, 
19^2; Byrne and Carl son a 1982} have used causal modeling approaches to 
thow*that academic achievement is more likely to predict academic 
self-concept or global self-esteCT t^arf^are*self -concept measures to - 
predict academic performance* The timlrigxf fhe measurements of 
academic achievement (spring, 1980) and seW^oncept (fall, 1981) in the 
present study supports the causal cencluslms of those earner studies* 
/ Positive academic self-concepts in Indian students appear to be the 
f resu 



__ult pf efforts to Improve academic performance, and they are probably 
not the' cause for improvement. 

• • v . -\ . v , ■ v • • 
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CHAPTER 5: EVIDENCE OF STUDENT ACADEMIC ACHIEVEMENT 
PROVIDED BY PROJECT PERSONNEL 

Blair Rudes * . 

* 1 > ■ * 

A. Introduct ion 

In the previous chapters information on achievement test scores was presented 
as evidence of Indian student academic performance. However, the design of * 
the Title IV, Part A evaluation recognized that multiple measures of academic 
performance were desirable because all types of measures (including ;te$t 
scores) have both strengths and weaknesses, .Thus, in addition to test score 
information, the evaluation collected- information concerning student academic 
performance from project staff, teachers, tutors, parents, and the students 

\ ■ - 

themselves, so that a more reliable and accurate assessment of student 
performance could be made* . - 

7 * } 

' This chapter, presents the results of open-ended -questions to project staff 
concerning the impact of Part A projects on student academic performance, 
Ratfngs from project staff* teachers, tutors, etc, using clpse-ended^ 
questions are presented in the three chapters which follow, 

. Bm Procedures v 

* To supplement the structured surveys and Interviews during the spring data 
collection, data col lectorsj<ere instructed to seek information from project 
directors and other staff concerning specific eviderice(s)" of the Impact of 
vth^ir Part A projects on academic achievement. .Such evidence could come from 
project-evaluation reports, data used in Jwriting the program plan, staff 
analysis reports, district reports and evaluations, or other sources, Where 
project directors made reference to the existence of such evidence, the data 
collectors were told to obtain copies and provide- these to Development 
Associates for analysis* Where the evidence cited by the projee* directors 

,., was anecdotal in nature, the data collectors j<ere Instructed to user thefr*-^ . 

f Judgment in deciding whether to pursue the matter further. They were told, 
J such as grades, or 
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corroboratory opinions from teachers, parents, students, etc , , from school 
files. At the end of each site visit, the field data collection teams jtfro£e 
narrative descriptions of; j / 



• The Impacts which the Part A project had upon academic achievement of Indian 
students, both present and past, as cited by the project director; apd 

• The' written evidence of thls^mpact' from site documents* and/or the /names of 
Individuals who provided corroboratory opinions where only anecdota/l 

1 nf ormat j<Gn was provided. * I 

- I " ; 1 

5\ I 1 t 

"In writing these reports, th€ data collectors wer^ instructed to provide /exact 
quotes of comments by project directors and other respondents, and tof^rpvide 
specif ic numbers of students evidencing a particular impact, Yfiis approach 4 
increased the Tike! i hood of gaining accurate impressions from these \ 
respondents. . 



C, Results 



For six of the 115 projects visited, no information pertaining to this portion 
of the study was provided by the data col Vectors concerning the Impact ^of the 
project on academic achievement. In ten projects, the project directors tand 
others contacted in this regard reported that they did not know whether or nojb 
therTTTatK^een any impact, In an additional 17 projects, those interview 
stated explicitly that their projects were having no impact on academi^ 
achievement, Thus, no further Information was obtained for these 33 (29%) 
projects* - \ 

At the remaining 82 (71X)- projects, . those interviewed indicated that the\ir 
projects were having some form of positive impact on academic* achievement. 



1 Ninety of the 115 Part A projects ' visited indicated that they had^formaj ^litCK^".) 
rial /academic assistance components, and 75 are included among the 82 projects 
discussed above." These 75 projects ascribed their acad^ical ly-rel ated achi eve- 

• merits to the tutor iaT/academlc cbmponint- of thei r projects ^tWa ^i^in^is 1 
projects explicit! v ftr imM if foTy v»«**-4h*H their posit4ve^ 

-^hrfeveSjent to the activities of their cultural or counseling components . J >; 
contacted at 15 of the 90 projects having a formal tutor ta 1 /academi c ach lev _ 
assistance component reported ^eitherthftt they were unsure if any Impact had 

^urred^^g^Jiecause of lack of test, score data) ,or\that^ao, impact had yet 
occurred in this area. 122 < S ; S 
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A w^de variety of different types of evidence wat, cited and collected in 
support of these statements. Table 5-1 summar^^rf the types of evidence 
reported and e the number of projects reporting each type* It should be noted 
that a number of projects cited more than one type of evidence for their 
claims* 

In 20 cases, those interviewed made generally positive statements about the 
impact of the project on acjfiemic achievements but nothing mbre specific was 
provided, The greatest proportion (42) of projects* however, cited the 
results of standardized achievement tests as evidence that their projects were 
having an Impact, Of thes^ projects, 32 supplied documentation for their 
claims in the form of actual test score data,* and the cf ted. evidence 
substantiated theTr claims of project impact, These data were included in the 
analysis of test scores that was described in the prior section. The N • 
remaining ten projects cited "test score results from ^project evaluations or 
other project/school documents which were not available to the d^ta 
^-collectors. 



Twenty-one projects cited improved student grides as evidence of project 
impact on academic achievement. In only four of theje cases, however, was 
documentation provided. Of these four, three projects cited the information 
collected by the pre/post-tutorial instruments used in this study. (For the 
analysis of these data, see Chapter 6, ) The other, project provided the pre- 
and post-tutorial grade point averages for nine students, showing an average 
increase of .9 grade point after six montfis of tutoring. For each of the four 
projects, the' evidence provided substantiated their claims of project impact. 
The remaining 17 projects provided undocumented citations of improved grades, 
but differed widely in the form in which they^ported their evidence. Their 
evidence may be divided roughly into three categories: those citing group 
statistics on improved grades (5 projects), those citing group anecdotes on 
Improved grades (3), and those citing Individual anecdotes on Improved grades 
(9), Typical of those citing group statistics were statements such as: 



-Of the 1 17 students tutored, 88% were at grade le^el— overall 1,3 grade 
level improvement in subjects tutored. " 
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TABLE 5-1 



TYPES OF EVIDENCE CITED IN S 



Type 'of Evidence. 

1. Standardized test score resultsi 

. § Documentation provided to data collectors , ,4 
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4, Classroom assignment (all .undocunntea)! 

a. Transfers to gifted/talented class , 

b, Decreased nuvbers of pUcamants in renediaV class , 
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Group anecdotes lacked the statistical format of the above example, and are 
typified by the ^following quote: , • 

".. .75-85% improvement in the grades of the 150 students served by tutoring* 

5 " ■ 

Individual anecdotes generally consisted of reports by parents o^ye achers 
Such as: ! \ 

"...one 7th grade Student who had Fs last year, this year ha 
as a result of tutoring* 14 (resource teacher) 

' i y 

"One parent reported her child's grade /of D In math going to B within the 
* same semester because of tutoring, 1 ] j\ 

"One student wai a C student before tutoring; afterward an A student,"* 




Increases In the number of Indian students receiving awards, scholarships, 
honors, and/or other types of recognition for academic achievement were cited 
as evidence of project impact on academic achievement at 14 of the projects, 



Changes in the classroom assignment of Indian students were cited by four 
projects* Increases .In tfte numbers of Indian students assigned to gifted and 
talented classrooms had occurred as a result* of the project, according to 
respondents in two projects* The Interviewees In two other projects reported 
that fewer students had been assigned to remedial classrooms since their Part 
A projects began* 



' ■ ' *\ . ■ 

In addition, nine projects reported Ja Ipi^i^^^pout rate among Indian . — 
Students as evidence of the Impact of their projects on academic achievement, 
° Also^three projects cited Improved classroom discipline on the part of Indian 
students as evidence of impact In the^areaNtf achievement, 

D« Summary ■ . ~ 

approximately. 70% of Title JV, Part A projects, project staff Indicated 
S^' that they thought that the project had -had a positive impact on the academic 
* " achievement of Indian students i lfl support of the^r conclusions, project^ 
fefe staff cited such evidence 's test results, classroom grades,^ awards and 



honors, and classroom assignment, Although the results cited could be 
documented in mily approximately half of the cases, they do suggest that Title 
IV, Part A projects are having positive Impacts on Indian student academic 
achievement* , -- 



CHAPTER 6: TUTOR RATINGS OF ACADEMIC IMPACT 



Aurora Martinolich and Paul Hopstock 



Introduction t "_ 

An important source of information concerning the impact of academic/tutorial 
programs were the Individuals who provided tutoring to students. e As described 
in Chapter 3, *td£ors were asked to complete three types of data collection 
instruments: (1) a Tutor Characteristics questionnaire, in which the tutors 
described themselves and their experiences; (2) a Characteristics of Tutored • 
Students questionnaire, which was completed for each student either in the/.^ 
fall of 1981 or when tutoring began; and (3) a Post-Tutorial /Sped al Program 
Follow-up, which was completed for each student^hen tutoring ended or when 
the spring data collection occurred. A* 

There were a number of items on the second and third Instruments which served 
as pre- and post-measures of academic Impact. Tutors were asked to rate each 
student in those areas of academic performance which were relevant to the 
tutoring. Ratings were made in reading, mathematics, writing, and social 
studies, although the foeus ofjtMs chapter is primarily on the reading and 
mathematics ratings. Ratings were. made on five-point Likert-type scales, 
ranging from M low" to "superior* M 

Tutors were also asfcfd to provide pre- and post-ratings for each student on 
the variables of seTf-confldence, Interest In school work, dlassropm' 
attendance, and conduct In school. These variables were rated on a similar 
scale as described above. Selected findings concerning self-confidence and 
interest in school work are presented in this chapter as well. 

The major* Impact variables (ratings on reading. and, mathematics) were analyzed 
using a very broad range of*proJect, tutor, and student variables. Simple 
cross-tabulations and breakdowns were first performed, and then academic 
ratings were analyzed through^ techniques. The purpose of 



these analyses was to determine which factors were significant predictors of 
tutor ratings of academic impact, 

8, Procedures 

Data from the Tutor Characteristics and Pre-Post Tutoring Improvement forms 
plus selected project level cross-break variables (such as geographic location 
of the project, ratio of Indians to total students, and geocultural region) 
were placed Into a cornmonyanalysis fije. This occurred after each of the 
separate files had been examined to gain insights Into the nature of the 
tutoring program and characteristics of tutors* There were 3,528 students for 
whom either a pre or post form was available, In terms of grade levels, 24 
percent were in grade 3 and below, 33 percent in grades 4-6, 35 percent in 
grades 7-9, and 7 percent in grades 10-12. However, since not all^tudents 
were receiving tutoring In the same subject area* and because pre- and 
post-ratings were unavailable on all students, the impact analyses presented 
here are based on considerably fewer cases, That is* analyses of mathematics 
improvement^ are based on 1,756 students, and thjose of reading progress are 
based on 1,495 students. 

Reviewing the patterns of data, It appears that no "major biases "or shifts in 
the findings were introduced by using only those students having pre- and 
post-tutor ratings in re^ng^ and/or mathematics for analysis purposes. Those 
being tutored in any one of four other areas amounted to fewer than 
one-quarter (231) of the students* whereas over, three-fifths of the students 
were being tittered in reading artd/or math (61% and 70JJ, respectively)* The 
. pre-distributions of tutor ratings of all students In reading (N-1863) and 
math (N=*2141) were x also examined and compared with the pr e-d 1 s t r 1 b u 1 1 on s of 
tutor ratings for those students having both pre- and post-tutor ratings^ 
(1M495 and 1756, respectively}* For both subject areas* the distributions of 
* pre-ratlngs wire extremely similar, differing by no more thin two percentage* 
points, and then only 1n one of the five rating scale positions. ^The- 
proportion of students In various grade ranges w^s also quite similar. Thus, 
no apparent biases were Introduced by using those students who 'had both sets 
of tutor ratings. 
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However, the possibility does,,, of course, remain that the ratings made by 
tutors are not fully valid. The tutors were paid by'thef Part A projects and 
were effectively being asked to rate the result of their own work. Thus,* some 
se Tf_ ser ving response bias may have been introduced, although it would, have 
required tutors* to coordinate their fall and spring ratings on individual 
students. Also, it is possible that the single item rating scale formats Ijsed 
were too "global" to indicate the^full extent of student improvement over the 
time they received tutoring* 1 

The major analytic approaches used were frequencies, breakdowns, and multiple 
regressions* A series of regressions wss performed, first with a composite 
dependent variable which combined the post-test scores of alt rated subject 
areas, and then separate analyses using post-test rriathematlcsl and reading 
scores as dependent variables* In all regression analyses, the corresponding 
academic pre-test measure was forced Into the regression equation first, to 
act as a type of covariate and control for* initial levels of. academic 
performance* Throughout the regression analyses, pa|rwfse rather than 
1 istwise deletion of cases was used In order to maximize the number of cases. 



C* Findings 

* 

Pre-test and Post-test Ratings 



Almost three-quarters (74%) of the students overall were jrated by tutors as 
having shown specific academic Improvement attributable \to tutoring- The 
basis of assessment included informal observation of dai\1^ work 152%) and 
improved grades (25%), as well as test scores* Over half jof the gains were 
measured by performance on tests of various types, 24% based on classroom 
tests* 13% based on achievement tests; 7% on curriculum-based pre- and 
post-tes|s, and 10% on other pre/post-tests* 

Examination of the two distributions pf ratings (pre and p^stj mabe by the 
tutors indicated some overall improvement* The mean rating for reading 
increased from 2.0 to 2*5, and the. mean rating for math increased from 2.1 
from 2.7. (The standard deviations for each set of ratings were the same, 
0.8.) The patterns of pre- and post-rating scale shifts in read i rig and math 
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contained in Tables 6-1 and 6-2 confirm this Improvement. Just over one-half 
(51%) of the students tutored in reading demonstrated academic Improvement, 
while slightly fewer than half (46*) remained at the same relative level of 
performance. Only a small percentage (3%) declined in relative academic 
level. The ^ratings f,br those tutored in math were quite similar* 48 percent 
improved, 48 percent^ performed at the same relative level, and 4 percent 
declined in performance. . 



Furthermore, most of, [the gains registered were made by those at the lowest 
initial levels of performance- Collapsed over subject areas, almost^ 
three-quarters (71%) bf those Initially rated as low In performance improved, 
while. only half (53%) I of those rated as below average demonstrated. a gain in 
performance. These differential improvements are far greater than could be 
expected by a regression to the mean effect, v 

Similarly, the tutors also noted improvement in the students' , interest in 
school work and self-cinf IdeneC as presented in Tables 6-3 and 6-4, re-^ 
spectively. However. Here too-some regression effects* are evident, especially 
in the "average" catenary on the self-confidence pre-measure, some- proportion / 
of these students belngl rated as below average on the post -measure* 



\ 



iThe apparent improvement 1 
effectiveness. Part of th 



ratings Is not^ntlrely associat\jjd with ^program \ 

w . _. . _ improvement Is due to "regression toward the mean'k^^ | 

s tatlsMcalartlf acts (I.e.L low scores tending to improve and high scores ■; _ ||| 
tending to decline, as a purely statistical phenomenon). This occurs because, of 
the Imperfect bivarl ate correlations of pfe- with post-ratings which exist fort 
reading (r* . 60), math (r? 157} and the composite index formed across all^, / ^: 
tutored subject areas (r- ,32), As a^sult %f these ILtest^retest" c^relations'| 
being fairly hi ghy yet substtoiti ally less than 1.00, such patterns as *the^ j ^ 
following occur s found in Tables 6-1 T, and a similar one In Table 6-12:\ . 

t 27 percent of those abive -average on the pre-reading measure dec lined x tOj ^ 
either below average ort low for at .'least* two rating scale points awaj£; jmd 



• 45 percent bf the It stWents rated as superior *,on the readlng^nleii 
t decl ined ,tjo averages \ ,v ;:' . ?\\.;. /^3£ ! '<,■■'■ ' ^ ; 
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*A11 cell percentages are based on the numbar of stints having the corriiponditij/Pfl'n t(W in that m 

k *W represents the beginning of tutoring for thiiwl m W m vian 
spring da«a>i:Qllect1on visit occurrtd. , ■, 



For the pwpose of computing means. 
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BLE 6-2 

PRE- AND POST-TUTOR RATINGS Of STUDENTS' RELATIVE. ACADEMIC 
LEVELS fN MATH (N 5 1756) 



■k* 



Low Below Average Average Above Average I 1 Superior 



k 



Row Totals* 
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1 
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*"Pre" represents the beginning of tutoring for the school year, "Post" when tutoring ended or 
spring data collection visit occurred, '.. 
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. TABLE 6-3 

PRE- AND POST-RATINGS OF TUTORED STUDENTS' INTEREST IN 
SCHOOL WORK AS RATED |Y THEIR TUTORS 



X 







Post 


- Rating* 




(N=1814) - 


* Low . 


^27% 


10% 


Below average 


47 


37 


Average * 


22 


45- 


Above average 


3 


7 


High ^ | 


1 


1 


Mean Rating" 


2,0 


' * 2,5 


*1 ^ Low; 5 = High 



TABLE 6-4 



PRE- AND POST-RATINGS OF TUTORED STUDENTS ' SELF-CONFIDENCE 
AS RATED' BY THEIR TUTORS 

. ; W. 



Rating* 


Pre 
(N=32T6) 


Post 
(N^fDTl) 


Weak 

Below average 
Average 
Above Average 
Strong 


7% 
30 
51 
10 

-j. 3 


3% 

22 ' 
59 
13 
3 


Mean Rati ng^^ 


^ 2.7 




*J ^0mi 5 ^ 

-^^^ 


Strong. . 




.- - -. 


\ 
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Factors Associated with Changes in Ratings 



In order to investigate the relationship between certain project, tutor, ana" 
student characteristics with changes in tutor ratings of reading and <_ 
mathematics, further analyses of variance of those ratings were performed, 
Raw difference scores were calculated between fall and spring ratings of 
performance in reading and mathematics, and the difference scores were used as 
dependent variables in analyses of variance. Because the Initial scores 
ranged from T to 5, the difference scores had theoretical ranges from -4 to 
+V with positive numbers meaning improvement. The actual distributions of 
difference scores are presented in Table 6-5, 





TABLE 6-5 




DISTRIBUTION OF 


1981-82 SPRING. MINUS FALL DIFFERENCE SCORES 
IN READING AND MATHEMATICS 


Difference Score 

-2 
-1 

0 

1 

2 


' — Reading — - 
(N= t49bj 
1% 
3 
46 
43 
7 


Mathematics 
(N=l/b7) 

0% / 

4 / 
48 \_y 
40 

8 


TOTAL 


100* 


. 100% 



2As Ljnn (1979) quite correctly put It, (p. 86) : "there is . . , a fairly 
aeiiel^L-awareness that there are problems associated with the^ measurement of 3 ; 
chanqer«lndeeclv there have been articles and entire books written about the 
topic for the last 20 years. The main purpose here for using, this technique was 
to assess the overall direction of reading and/or math scores oyer the school 
year and to determine if overal 1 shifts In scores were^related to program Parting 
elpation. Thus, another of Linn's comments 1s, also relevant preferring to one ^ 

-of the often-cited weaknesses*bf difference scores, low reliabilities. 

Low rel 1ab1 1 Ity of a difference score 1s a serious problem where di fference ?| 
scores are used tfl^make decisions about Individuals. But . . . for* groups, | 
the reliability problem is a much less serious concern. Thus, this featur^of-^ 
difference /Scores, for which they are most frequently maligned, 1s not fatal 
flaw witMn the context of educational evaluation Studies. (1979, p. 87) 

See also kanouse et al . (1980; appendix A) for an application^ dlffereHce 
scopes >to (pr^it^f^dimj^ other; graduating High school students post- 
secondary experiences . . -- •. \ 137 
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Reading difference scores varied based on the location of the project* the 
rice of the tutor, and the total number of tutoring hours In the year (weeks x 
hours per we?k). Students In urban projects had lower reading difference 
scores (mean=,37) than did students in projects on or near reservations ( .58), 
in other rural areas ( .56) , or in metropolitan areas (.55) (F=3.48 s df=3/1491, 
■> p< 05). 

Students with Indian tutors hao higher reading difference scores (rnean^, 58) 

4han students with non-Indian tutors (.42) (F=11.89 t df^l/1310/p<-001). 
Iso, as the total number of tutoring hours per year increased, the reading 
difference score also /tended to Increase (see Table 6-6), 

TASLE 6-6 

MEAN READING DIFFERENCE SCORES BY TOTAL HOURS OF TUTORING 



Number of Hours of s 




Mean Reading Difference 


- - 


Tutoring In Year 




Score 




1-25 


• 343 


.43 




26-5Q_ 


304 


,58 




51-99 


386 


.55 
.62 




100 or more 


330 




Not given 


132 


.58 




F-3..63, df-4/1490, p<.01 



Math differ /nee scores were related to the location of the project and the 
total number of tutoring hours per year. Students in projects on or near 
reservations had higher math difference scoref" (mean- • 61) than did students in 
metropolitan (.54), urban! (*50) ? ar (TCher r*ural areas (-48) (F=*3.36, 
df*3/1753» p <.05). As shown in Table 6-7, students who had hadL moderate 
mounts of tutoring had higher math difference scores than did students who 
either ^ad a little or a great deal of tutoring, / 



as 



ERIC 



6-10 



• . TABLE 6-7 

MIAN MATH DIFFERENCE SCORES BY TOTAL HOURS OF TUTORING 



Number of Hours of 


Mean Reading Difference 




Tutoring in Year 


Scope 




1-25, 


.42 




26-£0 


.69 




51-99; 


,53 




100 or more 


.47 




Not given 


.50 




F=3.56, df =4/1 752, p < .001 







Although these differences between groups reached levels of statistical 
significance, they failed to explain much of the variation in terms of reading 
and math difference scores. The eta squared values for the differences 
presented ranged from .0057 to .0148. Multiple regression approaches were; 
thus employed to determine which factors were more strongly related to tutor 
ratings of performance in reading and mathematics. 

Regression Results 

Stepwise multiple linear regressions were performed separately on math and ? 
reading post-test scores, using as potential predictors a broad range of 
variables from the Characteristics of Tutored Students form (the pre- tett>* : ;-',^ 
the Post-Tutorial Follow-up form (the post-test), and the Tutpr 4 Chararteri^t^ 
questionnaire, along'' rfith selected project variables such as ^location of the V 
project , ratio of Indian to total students * and geocul tural region . In each v ^ 
regression, the pre- test measure (either math or readings-was forced in to^ the ^ 
equat Ion first, to control for initial rating levels. Since the pattern of 
results was similar for both math and reading outcomes, only the results for ^ 
math outcomes are presented below. The math results are presented because - 
they Were based on more cases, and. thus are .'Statistically .more rel1a^leir;f;:;;'.;^ 
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Three criteria were used to select variafeU.es sfor inclusion In the prediction 
equation, The criteria were: (1) the statistical significance of the overall 
F- ratio for each step in developing the equation; (2) an Increase of at least 
1 percent of additional explained variation (or change in R ) ; and (3) a 
beta weight size of at least + .1, The use of these criteria reduced the 
number of -Victors by more than one-half* 

The surwnary table reflecting the sequence of variables 1 entry Into the 
regression equation and what improvement they made to predicting post-test 
math performance are presented inHable 6-8* As can be seen, it was possible 
to predict post-test not performance quite well; however, the pre-test of math 
performance and a post-measure^ of interest in school work were the only 
variables which increased R 2 by more than ,05. No tutor or project 
variables entered the predication equation. Also surprisingly, the number of 
hours per week of tutoring and number of weeks of tutoring did not enter the 
equation » , 



TABLE 6-8 

STEPWISE MULTIPLE RESRESSION SUMMARY WHEN USING 
THE POST^TEST MEASURE IN MATHEMATICS AS A 
DEPENDENT VARIABLE 



Predictor 
Variables 

Pre7test math rating 

/ • 
Post-test rating of interest 
in school work 

Post-test rating of self- 
confidence 

Tutor rating of overall 
academic improvement 



Change in Beta (Standardized Simple 
,r Regresslon^Coef f iclent ) Correlation 



Pre 



■Sest 



measure of interest 



in school work 




.439 
.259 
,217 
.164 
-.140 



.574 
.508 

.-515 
.287 
.360 



Multiple R*.70, R-.49, F-218.47, df^5/1129, p^.001 (N*1135), 



mo 



ERJC 



6-12 

The negative standardized regression coefficient associated with the pre-test 

measure of interest in school woj^w^an artifact, caused by a high correla- 

tlon with the p^st-test me^sua^^f intekest. The high correlation (,673) of 

these two Items meant that whichever entered the regression equation first 

would mask the effects of the other item* A similar situation affected the 

post-test ratings of interest in school and self-confidence, which were also 

highly correlated (.663). In fact, in the regression of post-test reading 

scores, the post^test measure of self-confidence entered the equation right 

after the pre-test of reading, and thus accounted for 10.9% of the variance, 

white the post-test of interest In school work accounted for only an 

3 

additional .73% of variance. 

The failure of measures of intensity of tutoring to enter the regression 
equations was very surprising. The simple correlations between post-test math 
ratings and hours per week of tutoring and number of wkeks In the program were 
,152 and ^.090, respectively. These results show, therefore, that although the 
amount of tutoring is related to outcome ratings, other factors are 
considerably more Important in explaining those ratings. 

^timmary * 



Individuals^ who tutorad students reported that approximately three-quarters of 
those tutored had improved their academic performances as a result of the 
tutoring. When tutors gave fall and spring ratings of performance 1n reading 
and mathematics, half of the students rate^ in each subject were given hi ghjerg 
ratings in the spring than in the fall, and almost all of the remaining ; v ;:.;^;|^ 
students were given the same rating.* Almost three-quarters of those ; who were^s 
given the lowest rating in the fall were given Higher ratings In the spring,; 
Indicating that, those most in need had been most likely to Improve their y s 
academic performances. ,5 



3The colloquial term N bouhcing-beta M has bim us|d 1n the statistical litera-v 

> ture ta lndicate a vaM in one s, | °T-- 
dataV and /Wtiem subit^tlW^apbdrfr predictop^i^able^j^riothir sample |gg| 

drawn from the same population. 

> >-„-: . sr ..." ' ~-y-'^iCJ&. x i'^'s." -*■.">!• • ..-y>?M 
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CHAPTER 7: RATIN6S OF PROJECT-RELATED ACADEMIC GAINS 
BY PARENTS, TEACHERS, AND STAFF 

■ * 

5 6* Hike Charleston 

A* Introduction " 

As- part of the evaluation of the Impact of *ttm Part A Entitlement Program, 
<fata were collected on the academic gains of Indian students as assessed by 
teachers of the Indian students* project staff, and parents of Indian 
students* The data were collected by survey items which asked hdw~~much the 
project had helped to improve student performance in readings language arts, 
and mathematics, and how much the project had helped to Improve student 
grades. The same scale of 1 (No Impact), 2 (A little Impact); 3 (So^e 
Impact), and 4 (A great deal of Impact), was used in all items. The scores on 
reading and language arts were combined to produce 'an overall language arts - 
score. For analytic purposes, the .scale was .assumed to be an interval scale. 

There were three respondent groups:, regular classroom teachers of Indian 
students, parents, and staff of the project. The teachers and staff were 
asked to assess the* Impact of the project on language arts (Including reading) 
and mathematics* Additionally, teachers were asked to assess the impact on 
student grades. Parents were asked about th^ J projects 1 impact on grades* 

^ ; ■■ • 'v /. ■ ., . ; • 

The impact measures were analyzed by project location and mount of effort 
spent on. basic skills (Instruction in language arts and mathematics). Those 
projects formally spending effort to Improve performance In basic skills, were 
compared with projects reporting no hours of effort on basic skills. Projects 
were also categorized by the ratings of level of impact on student grades. 
The projects in each category of impact on grades were* compared on the amount 
of effort spent on basic skills and other academic instruction. 



B._ Procedures ^ 

Data were provided by respondents in each project about the impact pf their ^ 
projects on Indian student academic perf ermanee. The responses of teachers 
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staff, and parents were averaged within each project to provide a mean rating 
per project from each of the three respondent groups, Additional Information 
concerning the extent of effort Isfinded by the project was merged with the 
Impact measures. . 

The Statistical Analysis System (SAS) Summary procedure was used to calculate 
the means of various classification variables* The relationships among 
variables were assessed through the use of the SAS General Linear Model and 
Correlation procedures, The means of the classification variable^ were 
graphed by computer to Illustrate the relationships among the classifications 
of projects. There were 101 projects in the sample with valid daia for these 
analyses. k - \l 

/ 

Findings ^ 

\ ' * 

Analysis of Academic Impact by Location 

" " " " : " " " ~ ' "w . • 

The ratings of teachers, staff and parents with respect to academic gains 
first were analyzed by location of the school district, These were four 
location groups: on or near reservation, other rural* urban, and metropolitan, 

The projects' Impact on performance of Indian students In mathematics was 
reported by teachers of Indian students and by staff members of the Part A 
projects. Overall, the classroom teachers In the 101 projects rated the 
project impact on mathematics at 2,8 on the scale of 1 to 4. The project 
staff rated the Impact 2,8 also. The ratings of teachers and staff varied 
somewhat by location type. Figure 7-1 illustrates these differences. In j 
urban projects, both the teachers and the staff rated the Impact on | 
mathematics lower than in other -types of locations. The teachers and^taff iip 
other rural locations ^ave the hl-ghest ratings* . at 3,0* some Impact. The 
difference between urban and other rural projects was statistically 
significant at the p <.05 level. v - ./V- 

Both teachers and staff reported relatively high levels of Impact of the 
projects on language arts (Including read IngJ^erforminct of Indian students. 
The teachers rated"the projects at 2.9, on the average, while the staff rated 
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the projects at 3*0* The ratings of the two groups tended to be close In all 
locations as show In Figure 7-2, The urban respondents rated the projects 
slightly lower than those in other locations, although there were no / 
statistically significant differences, / 

/ / , 

Project Impact in terms of grades was reported by teachers and parents. On 
the average the teachers and the parents both rated the Impact on grades at 
2-8- A breakdown of these ratings by project location appears in Table 7-1 . 



TABLE 7-1 

MEAN RATINGS OF IMPACT ON GRADES SY PROJECT LOCATION 

(N-101 projects) 




The analysis by location show that projects In metropolitan locations ha^ the 
1 owes Votings in terms of imp^etlon grades, / significantly Jower than projects 
near reservations or in othh^ rural locations. Projects in urban 
cations received intermediate ratWjs, wit^ parents rating them near . v : 
average* while teachers rated them well below a 
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Analysis of wipaet by Hours of Project Effort on Basf e Skills 




r, - .. * 



The projects varHed 1n the number of hours of /iff art per student per year ' ";v'|§ 
which they spentAon special instructional activities in basic ski Tls\£( language^ :J 
arts and mathematics). Table 7*2 shows the distribution of* projects by hours 
of effort on basic skills. 
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TABLE 7-2 

DISTRIBUTION OF PROJECTS BY HOURS OF EFFORT ON BASIC SKILLS 



Hours of Effort 


Number of 


on Basic Skills . 


Projects 


0 Hours (reference group) 


26 


1 to 20 hours 


2 


21 to 40 hours 


11 ' 


41 to 80 hours 


13 


81 to 160 hours 


29 


160 or more hours 


20 


Total projects 


1W 



Of the 101 projects from which data were available, 26% spent zero hours on - 
special Instruction in language arts and mathematics. These projects served 
as a reference group for comparisons with the 74$ (N-7S) of the projects 
expending effort on Instruction in basic skills* These comparisons permitted 
an analysis of the relationship between increases in hours of effort on basic . 
skills and the ratings by the various respondent groups assessing the impacts 
of the projects. 



The ratings of project Impact on Indian student performance In mathematics 
broken down by hours of effort are shown In T|ble 7-3, 

: TABLE /-3 

PROJECT IMPACT ON MATHEMATICS BY HOURS OF EFFORT IN BASIC SKILLS 

(N-101 projects) k 







Project 


Hours of Effort* 


Teachers 


* Staff 


0 


2.45 


■\M 


1 - 20 


3.21 


2.00. * . 


21 - 40 


2.62 


3.36* 


41-80 


2.85 


3.37 ■• 


81 - 160 


2,90 


, 3.14 


161 or more 


2.96 


3.04 


F( Hours of effort)*8.8Q, 


df=5/190, p < .001. 


- t '. £ :f. 



The data indicate that ratings on mathematics In projects expending eff^r^on^ j 
basic skills Instruction were higher than ratings In the ref erence group* ThirS 



number of hours expended, however, was not related to^the ratings of impaction 
mathematics. It should be noted that the means in trie group with 1-20 hours 
in basic skrlls instruction were relatively unstable* because that group 
contained only two projects, 

m 

the ratings of project impact on language arts (including reading) broken down 
by hours of effort in basic skills are presented in Table 7-4; Ratings for 
projects which devoted zero hours per student per year to basic skills 
instruction tended to be Tower than for projects which devoted at least some 
hours to such Instruction* There were no statistically significant 
differences between groups, however, and there was no clear pattern of 
relationship between the nurtber of hours of "effort devoted to basic skills and 
the ratings of impact on language arts, * 



TABLE 7*4 

PROJECT IMPACT ON LANGUAGE ARTS BY HOURS OF EFFORT IN BASIC SKILLS 

(N^lOl projects) 



s of Effort* 

— r~ 

1 - 20 # 

21 - 40 

41 * 80 

81 *. 160 

161 or more 



Teachers 

3.25 
2.80 
2.89 
2,97 
2.89 



Project 
Staff 
2.54 
2,25 
3,43 
3,35 
3.06, 
2.96 N \ 



*The number of projects in each category is presented in Table 7-2. 



Teachers and parents rated the. impact of projects on improving grades of 
Indian students (see Table 7*5), The' ratings of both teachers and parents 
were extremely close. ' Both groups of respondents In projects expending effort 
on basic skills instruction tended to rate their projects higher than the 
respondents in the reference group, There was no clear pattern of 
relationship, however, between the number Qf hours of effort devoted to basic 
skills and ratings of impact on grades, 1 

' 148 . 
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TABLE 7-5 

PROJECT IMPACT ON GRADES BY HOURS OF EFFORT IN BASIC SKILLS 

(N-lQl projects) 



Hours of Effort* 



Teachers 



Parents 



1 

21 
41 

81 
161 



- 20 

- 40 

- 80 

- 160 
or more 



2, S3 
3,21 
2.75 
2.91 
2,89 
2.92 



2,58 
2,91 
2.72 
2,90 
2.84 
3.00 



F(Hours of effort) =3. 00, df=5/190, p < .05 

*fhe number .of projects in each category is presented in Table 7-2, 

r _ _ ' 



Level of Impact on Grades by Hours of Project Effort on Basic Skins and Other 
Academic Components 



The projects reported the average number of hours of effort spent per student 
per year for the components of basic skills (math and language arts) instruc- 
tion and Instruction in other academic areas, The ratings were analyzed to 
compare the extent of effort expended on these two components by level of 
reported impact on grades, The projects were categorized by rounding their 
mean Impact ratings on grades by the respondent groups to integers- The 
number of projects In each reported level of Impact is presented In Table 7-6. * 

. TABLE 7-6 \ 

DISTRIBUTION OF PROJECTS BY REPORTED LEVEL OF IMPACT ON GRADES " \ 
■ . % (N=101 projects) \* 

E\ • -■ A 



; — - 1 : . \ 

Categorized Mean Project Ratings As Reported By 

Level, of Impact* , Teachers Parents 

No .impact 4 1 

A little 16 17 

Some " < 71 72 

A grea* deal '10 8 

TOTALS IDT 101 



*The number of projects in each category is presented In Table 7-2. 
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The average number of hours per component were then calculated over all 101 
projects and graphed to serve as reference points for the comparisons. As 
shown in Figure 7-3, the projects rated at no impact -on Indian student grades 4 
by teachers had a mean of 21 hours of effort expended in basic skills 
instruction and in instruction In other academic areas. Projects rated by the 
teachers as having a little Impact had a higher number of hours of effort In « 
basic skills than projects rated at no impact, but they had fewer hours of 
instruction in other academic areas. Projects rated at some Impact on grades 
and a great deal of Impact had increasingly larger numbers of hours of effort 
expended in both basic skills Instruction and Instruction in other areas* The 
correlations between mean teacher ratings of Impact on grades and hours of 
effort on basic skills and other academic areas were .23 (p < .OS) and .12* 
respectively. 

The projects which were rated as having no Impact on Indian student grades by 
parents had a mean of 23 hours of effort In basic skills instruction and a 
mean of zero hours for Instruction in other academic areas (see Figure 7-4}* 
The parent ratings tended to Increase as the number of hours of Instruction in 
basic skills and other academic areas Increased* However, the projects rated 
by parents at a great deal of Impact on grades had fewer hours of Instruction 
in other academic areas than the projects rated at some impact. The parent 
ratings apparently reflected the Increase in effort in basic skills 
instruction rather than changes in hours of effort In other academic areas. 
The correlations between mean, parent ratings of Impact on grades and hours of 
effort on basic skills and other academic areas were both .16. 

D. Summary , _ 

The overall ratings of Tltli IV, Part A project Impact on academic gains as 
reported by teachers, staff ,\and parents were relatively high for all 
measures. The distribution of ratings for the 101 projects show that most 
projects were rated as having \some Impact on grades* mathematics, and language 
arts skills. The impact measures varied somewhat by the locftlon of the 
project. In general, urban projects were rated lower than the other location 
types on Impact on improving student .performance in, mathematics and language 
arts. y * 

150 
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- TEACHERS' GENERAL RATINGS 
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The projects expending effort to Improve math and language arts were rated 
higher than were projects which expended no hours of effort for these 
purposes. The number of hours expended* however* was not consistently related 
to ratings of project Impact on mathematics and language arts* The number of 
hours spent on instruction In math and language arts and other academic areas 
was somewhat related to ratings of Impact on* grades, 
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CHAPTER 8: RATINGS SY -STUDENTS Q*F THEIR PROJECT-RELATED ACADEMIC GAINS„ 

3, Mike Charleston 

A. Introduction 

■ 

The Part A Impact study collected cf ata from Indian students In grades 7 to 12 
on the extent to which the Tit lie IV"% Pant A project in their school districts 
had contributed to their learning f n (1) mathematics and (2) reading or 

* English language arts, The student 3 were asked to rate how muc^ti they had 
learned from the project teacher or- tutor who taught each of tNie two 

subjects* The students responded a scale of 1 to S □flwhicf'm 1 Indicated 

that they had learned nothing at al 1 and 5 Indicated that they had learned 
very much. The students could alsfr indicate that they did not have a Part A 
project tutor or teacher during thfc year, 

\ / 

The data collected from the secondat J-y students provided a means of assessing 
the impact of Part A academe instr action In reading and math f^rom the - 
viewpoint of the students receiving the instruction, The stude^nt impact 
ratings were analyzed by location o^f the school district and hours of project 
effort on rfeilng and math* They v#*ere also compared with the tuipact ratings 
of teachers and staff on gains in reading and math in the same school 
district* Thus* the impact of Part A on academic gains could te« considered 
-from the distinct viewpoints of stuxients, teaqhers, and staff, 

The students were grouped by the le^el of their ratings for additional 
analyses* For the variou^. levels &-f the student rat1ngs f tha average numbers 
of hours of effort to Jmprove readi wic^ and math performance and performance in 



other academic areas were compared. Also, the extent to which -the. students/ 
attributed learning to other source^ (reading and math teachers ^ other / 
classroom teachers, other tutors) vr^is compared with the amount of learning 
attributed to Part A teachers or tutors, • 
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B. Procedures 
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Data were provided by secondary school (grades 7 — 12) Indian stydgfrts in each 
project participating In the Part A impact study— The unit of analysis was a 
secondary school Indian student. The data w^re wierged with data firom teacher 
and staff survey instruments, as wall as datfa concerning specific project 
characteristics* In some of the analyses* the responses of thm students were 
averaged within analytic categories using the Statistical Analysis System 
(SAS) procedure Summary, The SAS General Linear Model was used to test 
differences between groups. In all of the analyses, the scale of the ratings 
was shifted from a 1 to 5 scale to a 0 to 4 scale- The shift simply allowed 0 
rather than 1 to equal the rating of Nothing at all, 

The analyses used various numbers of cases. Analyses Involving only studbut 
data could be performed on more cases than could analyses that included 
project, teacher, or staff data, 

C, Findings 

Extent of Learning In Math and Reading AttrlbuteJ by Students to Part A 

■it 

The students rated the extent to which Part A contributed to what they had 
learned during the year in math and In reading* Of the students vtfvo 
responded, 954 rated the impact on math and 1 ,t)B4^ rated the Impact on 
reading. Table 8-1 illustrates the percentage of^ studints in each subject 
area who rated the Part A project at each level f^T-om 0 " nothing im 4 « very 
much. Overall* the students rated the projects relatively high in impact for 
both math and reading. 

.* 

. '/■ 
Student Impact Ratings by Lpcation of the School District ' 

The student ratings of the Impact on math and reading varied by th^ location 
of school district (see Table 8-2), The highje$t ^ratings were glvgrt by 
students in rural (non-reservation) schools, who *~ated the impact o*n both math 
and reading equally high. The students in the urban schools rated the impact 
on reading considerably lower than did students other location^. 
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TABLE B") 



STUDI&IT RATINGS OF PROJECT IMPACT ON HATH AND READING 



Ratieri 



1 

Z 
3 



bthing) 



4_ ( Very Much } 
Tota 1 



Math 
( fH54) 

n 

9 

24 

, 29 
29 
111 
Mean Rating 



Reading 

11 

24 

32. 
27_ 

HI 



TABLE 8-2 J 

MEAN STUDENT" MATH AND READING IMPACT RATINGS BY £ 
(Scale: Nothing At All * 0, Vary Ngc 



iEOGRAPHIC LOCATION 
:h = 4) ( 



Location 

Oh or ngi_r reservation 

Other rur— al 

Urban 

Mstfopoli tan 



Math* 
(N*954) 
2,49' 
3, 86 
2,44 
2,66 










/ 








*F 


= 4.70, df * 


3/™ 950," p <, -Ol 










**p 


= 4.05, df « 


ir 1080, p < .01 











Student Im pact Ratings by Hours of Frojaci Iff oft M Reading and MathCT4 



ICS 



The students reisMnding to the survey Items attended % 
projects that vaarlad in the number of hours of effort 
year on Improving student performance in raiding and 
students with va*11d data, 16% were "in projects that r 
effort on impr(pv^-ing reading and math performance as i 
project, and 84^jware in schools that repertad formal 
reading and mt\m 1 pirfonnarTee. The students in projic 
hqurf of formal effort wer-m used as a ref irenee group 
projects expending various levels of effort, Ev§n ir 



schools uMch had Par — t A 

expgndid per studewit per 
math. Of the 739 
"eport^d zaro hours oaf 
i f ofnial component effi the 
[ effort to Improve 
:ts which reported 2^sro 
i for coprison v/ltfn 
i projects where th#r^re was 
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no formal tutoring in reading and math, many students did receive Infonntl 
assistance* so the reference group could not be considered a "ncs treatni^t" 
group* 

The students in the reference group rated the projects relatively high if* 
tapact their learning in both math and reading (2. 4 In math »nd 2,6 
reading) » * even though they were in projects that focused on are^s ©that* tto 
hiding »nd math (see Figure 8*1), As a result of other efforts by th^ife 
projects*^ there was perceived Impact in reading and math from thne viewpoi fit of 
the students involved, 

* r 

There w#i — -e only eight students frcyn projects that reported between 1 ahd 25 
hours of effort per student per year on reading aM math. The wary sm^ll 
number of^ students in this classification producid unstable mtar^s for 
student i — atings, and the results from this group should not bt over \ 
jnttrpreteed, * , 

The mean ratings of students in projects formally expending effort on 
Improving reading and math were slightly higher than the ratings of stijd^ 
in the reference group for both math and reading (with the excerption of the 
unstable means discussed above). Within projects expending forraial, , effort 38 
ratings v*-*ere very similar across projects with differing hours cr»f effort ... 
expended^ Projects expending 160 or more hours of effort were Wated at 4Wt 
the same level as projects expending 21 to 40 hours of ^prforfr. 

Student j^atings of Impact Compared with. Teacher and Staff Rat Insas 

The teacr-ners and Part A project staff at the schools were asked to. rate tilt'., 
Impact o«T the Part Ajarojeets on academic gains of Indian studei^ts re^g v 
and math during the school year. These ratings ware reported or?» a, sea If «M 
to 4» wiBfch 1 representing no Impact and 4 representatlng j grt«« deal ijf ! 
Impact, The scale of Impact used by the teachers and staff differed frpfntti ^ 
scale usc^d by the students only by the absence of a central sco**"« position for 
the teaehfier and staff scale, A comparison of thi ratings, of th« teacherbi 
staff, arrid students Is presented-ln Figure 8-2 for project impacrrt on math and 
In Figure 8-3 for project impact on reading^ ^ - f 
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STUDENT'S IMPACT RATINGS BY 

*' ' HOURS OF PROJECT EFFORT 



LEVEL OF STUDENT IMPACT RATING 



FIGURE 8-2 f 



STUDENTS' RATING FOR HATH BY 

TEACHER \ SIFF REPORTED IMPACT; 




FIGURE 8-3 



STUDENTS' RATING OF READING BY 
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Overall* the teach&r ratings of project impact on math averaged 3*1 on the 
scale o f 1 to 4. TThe stiff ratings averaged 3,2, For those students who* 
rated the Impact of* the project on their math learning at 0 (nothing) , the 
mean rating of teai^hers in the projects of those students was 2*9 and the mean 
rating of staff was 3.2. The impact ratings of the teachers were below 
average* while the ratings of the staff were at their average for projects in 
which the students reported no Impact on their learning. As the level of the 
student reports of impact increased*' the level of the teacher reports of 
impact also increased at a gradual rate. The level of the staff reports of 
Impact was faiHy c^ronsistent for all levels of student-reported impact* For 
project impact on rraath* the student and teacher reports tended to agree to a 
greater extent tham student and staff reports. 

Overall* the teacher ratings of project impact on reading averaged 2*9 on the 
scale" of 1 to 4. TThe staff ratings averaged 3.1 on the same scale. For 
students who rated the impact of the projects on their learning In reading at 
0 (nothing)* the m^san ratings of both teachers and staff in the projects of 
those students wai slightly lower than their respective average ratings. As 
the level of the strudent report of Impact increased from 1 to 4, teacher 
ratings remained* relatively stable, while staff ratings increased slightly. 

> The comparisons of the-ratings of teachers, staff, and students showed a 
relatively weak positive relationship between the ratings of teachers and 
staff and those of the students In the same projects. The lack of strong 
relationships may taave been due to the fact that students were rating their 
personal experiences* while teachers and staff members were rating J ^ 

, project-wide effectes. ■ . , ■ 

Hours of Project Effort by Student Reports of Impact Levels 9 

The projects expencMed various amounts of effort in reading and math 
Instruction and In InstruMlon in other academe areas, the extent of effort 
In these two comportaents was compared across the five levels of Impact reported* 
by the students *f oi — math Teafn4^8_^Figure 8-4) and for reading learning * 
(Figure 8-5). The average number of hours of effort per student per yejur for 
iaeh component was calculated ind plotted on the graph as a reference point* 
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FIGURE 8*4 

STUDENTS' REPORT OF IMPACT. ON 

* . ' ' MATH BY HOURS OF EFFORT 

1 i 




FIGURE 8-5 

STUDENTS' REPORT OF IMPACT ON 

HEADING BY HOURS OF EFFORT 




8-n 



i 



The averages vary for the two graphs because the graphs represent two 
different groups of students* 

The students reporting on the impact of the project on their math learning 
were in projects that* on the average, had spent 114 hours per student per 
year on reading and math and 76 hours on other academic areas. As the impact 
ratings by these students increased, the number of hours of effort in reading 
and math tended to Increase, The number of hours of effort in other academic 
areas tended to Increase to a high at the student rating of 2, the central 
score* and then decline with continued higher student ratings. 

The students reporting on the Impact of the project on their learning in 
reading were in projects that had spent an average of 112 hours on reading and 
math efforts and in average of 103 hours on other academic areas. For these 
students, increases in their ratings of project Impact on their learning in 
reading reflected increased hours of effort in other academic areas better 
than project effort in reading and math. 

Comparison of Learning Attributed to the Title IV Project with Learnin g 
Attributed to Other Sources • 

The students were also asked to rate the extent of their learning In math and 
reading which was contributed by sources other than Part A teachers and 
—tutors. TI??*Bther sources were regular math or reading teachers* other 
classroom teachers, and non-Part A tutors. The ratings of these other sources 
in comparison to Part A ratings are presented in Table 8-3. The table shows 
that those students who had Part A teachers or tutors rated their Impact on 
math and reading as approximately equal to the Impact of regular, classroom 
teachers. 



164 



ERiC 



8-12 



TAB LI 8-3 

MEAN RATINGS OF INSTRUCTOR EFFECTIVENESS 
(Scale: Nothing At All = 0, Very Much * 4) 





Math 




Reading and Lan 


guage Arts 


Source of Learning 


Respondents 


Mean 


Respondents 


Mean 


Reading or math teacher 
Other classroom teacher 


1,638 

__L672 


2,48 
2.69 


1,748 
,1,603 


2.78 
2.4S 


Part A teacher or tutor 
Other teacher or tutor 

, 1 


954 
1,523 


2.59 
2.35 


1,084 
1,456 


2.63 
2.26 



D, Summary 

Secondary grade-level Indian students rated the impact of* the Part A projects 
on their learning in math and reading and English language arts at a rela- 
tively high level. The majority of the students rated the projects above the 
central score both in Impact on math and in Impact on reading, These ratings 
were approximately the same as the ratings they gave to their regular English 
and math teachers, Students in rural* non-reservation schools gave the 



highest ratings. 




Students rated projects moderately high in impact even when the project had 
not formally expended effort for the purpose of Improving reading and math 
performance. However, the students in projects that did formally expend 
effort on reading and math tutoring rated their projects slightly higher in 
impact than did students in the projects where formal tutoring efforts were 
not provided, The ratings by the students were not strongly related to the 
ratings by the teachers and staff in the same projects, 

The ratings by students of project Impact on their math learning tended to 
Increase as the number of project hours of effort spent on reading and math 
increased, Student ratings of impact on their learning in reading *wer6 
positively related to the extent of effort expended on academic areas other 
than reading and math, 

... i6o • ;•• ■ t 
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The student ratings are somewhat difficult to interpret, because they are not 



strongly related either to the extent of project efforts or to teacher or 
staff ratings, The results could therefore be attributed to general positive 
feelings concerning the project. However* the fact that ratings of Part A 
tutors were as high as those given to regular math and English teachers, 
whereas ratings of non-Part A tutors we*e lower, does suggest that students 
believe that Part A projects are having positive impacts. 
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CHAPTER 9: SUMMARY AND CONCLUSIONS CONCERNING ACADEMIC 
PERFORMANCE OF INDIAN STUDENTS IN PART A 
PROJECTS IN PUBLIC SCHOOLS 

Paul Hopstock 



In the preceding seven chapters, a large number of findings concerning the 
academic performance of Indian students has been presented. In this chapter, a 
Tumnary of Those findings is presented, and an attempt is" m^rde to draw 
conclusions concerning the academic performance levels of Indiar^^Sjudents, and 
the Impact of Part A project on those performance levels* 

In reviewing the findings and conclusions. It should be kepcMn mind that 
although the Development Associates evaluation did collect a fair amount /6f data 
concerning the academic performance of Indian students, the evaluation had as its 
focus a broader concept of Impact of Part A project than would be provided 
through simple pre and post measures of academic achievement, Part A project are 
designed to meet the academic, cultural, and other personal needs ^of Indian 
students, so an overemphasis on academic achievement scores or ratings would fail 
to acknowledge breadth of Part A project objectives. 

Summary of Findings 

Existing data on the academic achievement levels of Indian students present a 
very complicated picture. A meta-analysis of studies using standardized • 
achievement tests In reading and mathematics, showes that among the Indian 
students tested, test scores were higher in the decades of 1950s and 1980s than 
In the 1960s and 1970s. In all cases, however, the data show the scores of 
Indian students to be below national means. The explanation for the differences 
in test scores within defiades Is almost certainly based on the nature of the 
sample groups tested, but the data in all cases illustrate the special academic 
needs of Indian students. 

In response to their students' academic needs, the Development Associates 
evaluation shows, approximately 80S of all Title IV, Part A projects provided 
some form of tutorial or special academic assistance services. Almost all 
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academic programs were designed to supplement classroom activities rather than to 
replace a part of the regular school program* Programs were generally held In 
school during school hours, and were designed to facilitate regular classroom 
instruction. 

Tutoring was most frequently provided in the subject areas of mathematics (90% of 
projects with some tutoring) and reading (89%). Tutoring was relatively intense, 
with a typical student attending four sessions a week through most of the school 
year* ' ' 

Most tutors were adult, female. (84%), and Indian (67%). Almost all ^£94%) project 
paid tutors, A majority (57%) provided training for tutors in su^n areas as 
subject matter content* cultural sensitivity, teaching techniques, and use of 
tutoring materials- Among the students who were tutored, two-thirds were rated 
as low or below average in reading and mathematics* Tutored students were rated ^ 
as average in school conduct, but lower than average in self-confidence and 
interest in school. 

An examination of the achievement test scores of Indian students at Part A 
project sites In spring 1981 Indicated that their reading and math scares- were, 
on the average, one-third of a standard deviation below the population mean, 
Achievement test scores were not strongly or consistently related to measures of 
Part A project contact or to the extent of Part A activities to Improve reading 
or mathematics performance. Achievement test scores v^ere positively related to a 
measure of student academic self-concept. 

When Part A project staff were asked In an open-ended fashion whether they 
believed that their project were having a positive impact on student academic 
achievement, respondents In almost three-quarters of the project answered 
affirmatively. In support of their conclusions* respondents cited such evidence 
as test results, classroom grades, awards and honors, and changes in classroom 
assignments. 

Ratings by Part A project tutors supported the conclusions of the project staff, 
Tutor ratings of Individual students Indicated that approximately 75% of students 
were rated to have improved their* academic performance as a result of tutoring, 
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Tutors rated students • math and reading performances In both in the fall and the 
spring, and in half of the cases in each subject, performance ratings had 
improved; in only 4$ of cases nad performance ratings, wbrsened. Performance 
rating gains were particularly likely among those students who had the lowest 
initial ratings, • 

Ratings by Part A project staff, teachers, and parents indicate that projects 
have had some impact on students 1 performances in language ^arts and mathematies s 
and on student grades, Ratings were generally lower in urban project than in 
project In other locations. Those project devoting formal project hours to 
improving math and language arts skills were rated more positively than project 
that did not devote formal efforts, but the number of hours of effort was not 
consistently related to parent, teacher, and staff ratings, 

Secondary- level Indian students also gave relatively high ratings of the imapct 
of Part A project on their performances In math and reading* Project tutors were 
rated as having as much impact on math and reading as their regular math and 
English teachers* Moderately high ratings were given, however, even in those 
project which said they did not devote formal efforts to Improve reading and 
mathematics* so the student ratings may simply reflect positive feelings about 
Part A project in general. 

Conclusions 

The results of the Development Associates evaluation and other studies have 
underscored the academic needs of Indian students, Indian student samples have 
consistently fallen below the means on standardized achievement tests* although 
the pattern of such scores appears to have varied across decades, 

Most Title IV, Part A project include a formal component to Improve the academic 
performance of Indian students. The Development Associates evaluation did not 
provide definitive evidence tfjat Part A project have Improved Jtidian student 
academic performance, Achievement test scores were not found to be strongly • 
related to program participation, by students or the extent of academic 
programming by project, 
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The nature of almost all Part A programs Is supplementary, however, and their 
impacts, therefore, .should be expected to be limited in size and focused on 
subpopulations of Indlan^students* Thus, analyses of student' achievement test ^ 
results, either of all Indian students or even of only those engaged in Part A 
activities, are likely to be too gross measures on which to base judgments of ^ 
project effectiveness, 

Individuals with knowledge of Part A project (project staff, tutors, classroom 
teachers, parents, and students) believe that Part A project have had at least 
^/some Impact, The ratings of these sources could be questioned on an item-by-item 
basis, but the cumulative effect of generally positive ratings leads to the 
cr fc ■ m that academic impact is occurring, The positive ratings of 
d1 crested parties such as classroom teachers are particularly meaningful, 
Also, as shown in Chapter 5, staff members in most project whicn reported 
academic gains ^ere able to cite specific evidence to support their conclusions. 

The data also Suggest that if academic Impact is occurring, the major 
beneficiaries are these with low initial levels of performance, Given the 
-limited Par^ A resources, It would appear that this emphasis on assisting low 
achievers is warranted, 
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PART B: PUBLIC SCHOOL ATTENDANCE AND RETENTION 



Th e need for more precise data on trends In Indian student attendance and 
retention has been expressed by a number of different parties, In both Congress 
and the general education community. Such Information Is heeded to determine the 
nature of the problems that exist In this area, and what the Title IV, Part A 
Program has done to Improve the situation. To address these concerns, a number 
of different types of data on attendance and retention were collected and 
analyzed: school and district attendance figures; dropout rates across the nation 
and at the sites visited for the study; and ratings, from parents, teachers, and 
project staff, of the role of local Title IV, Part A projects In Improving 
attendance and decreasing school dropouts. What follows Is a presentation of the 
findings. 

In the area of student attendance, school and district attendance figures alone 
are generally taken to be the primary source of data for assessment. However, as 
discussed In Chapter 1 of this report, a number of difficulties are associated 
with the use of such: the difficulty of collecting longitudinal attendance data 
for students who move from one school to another; the failure to compensate for 
late admission or transfer; and the failure to differentiate, with consistency, 
absences and tardles. In the area of student retention, shifts over time In the 
overall dropout rate are usually seen as the main Indicator of program Impact. 
However, these data are problematic as well. Operational definitions for a drop- 
out used by school districts vary, as do those reported In the literature by 
researchers and national agencies. The data problems are especially acute for 
mobile groups such as Indians, especially those living In areas witf^BIA and 
Mission schools as well as local public schools they might readily attend. These 
data sources have therefore been supplemented with other types of data to provide 
a comprehensive picture of the* problems with Indian student attendance and 
dropout and a through assessment of the impact of the Title IV, Part A projects. 

Each of the following chapters addresses the subjects of Indian student 
attendance and retention from a specific perspective. In Chapter 10, the results 
of longitudinal analyses of data for Indian student attendance over the four year 
period from 197fi-€0 are presented. Included are comparisons of Indian student 



attendance data with known and estimated national data and comparisons between 
data for subgroups of Indian students and the overall Indian student population; 
breakdowns of the Indian student attendance data by a series of variables. 
Including geogjphlc and geocultural regions, elementary and seeondary^frade 
dreuos, grade level, and sex; an analysis of the 1980 Indian student -attendance 
"data 1n terms of standardized math and reading scores for a portion of the 
students; and an examination of the 1980 attendance data In terms of Indian 
parents' general satisfaction with the Indian project and their perception of 
school personnel senslvity. Chapter 11 presents the analyses of teacher, project 
staff, and parent ratings of project Impact on student attendance. Chapter 12 
focuses on the subject of Indian student retention, Incorporating a literature 
review and an analysis of the Indian student dropout rates, over the past decade, 
at public schools receiving Title IV, Part A funds, "me results of direct Title 
IV Part A project involvement in reducing dropout, and project staff, teachers' 
and parent committee ratings of the role which these projects have played 1n / 
improving Indian student retention, are presented, Chapter 13 summarizes these 
-findings, and establishes the study's conclusions regarding the Title IV, Part A 
impact on Indian student attendance and retention. 
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CHAPTER 10: ANALYSES OF LONGITUDINAL ATTENDANCE DATA 

/ < 

I G. Mike Charleston 
A, Introduction / — - 



The Part A Impact study collected data on th3 attendance of Indian students In 
school districts having Part A Indian education projects. -The school dis- 
tricts were requested to supply the attendance and grade t level data on Indian 
students for the school years 1977*78 through 1981-82. Data were provided by 
the districts at different points of time during 1981, Therefore, the last 
full school year for which attendance data were available was 1980*81. The 
longitudinal analyses of attendance data thus used the reported attendance 
data for the years 1977*78 through 1980-81. 



The longitudinal analyses examined trends In attendance of Indian students 
over the four years, The mean attendance of the Indian students was compared 
with known and estimated national attendance data. The mean attendances of 
various subgroups of Indian students were analyzed for trends over the four 
years and compared with the overall Indian mean days of attendance trend, The 
Indian student attendance trends were analyzed by: 

_ • Geographic and geocultural region; 

• Elementary and secondary grade group; 

• Grade level of students; 

• Location type of school district; 

• Population density of Indians in the school district; 

• School district size; 

• Sex of the student; 

• Socioeconomic status of the student; 

• Hours of project effort per student per year in improving attendance; and 

• Proportion of the effort expended by the project— during the school day to 
Improve, attendance, y 

In addition* the 1980-81 /attendance of the Indian students was analyzed in 
relation to the Spring 19B1 "standardized math and reading test scores 
available for* a portion of the students. The 1980-81 1 attendance; was also 
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analyzed using the Indian parents 1 . general satisfaction with the Indian 
project and the Indian parents' perception of school personnel sensitivity 

+ toward Indians, 

. . . '" * 

B* Procedures 

m — 

The study sample of students was constructed by taking a probability sample of 
the Indian students in grades 4-12 who were enrolled In the 115 school 
districts visited, and who attended schools arid grades within those schools 
where Part A project activities were available, The 13,737 included In the 
sample were those who filled out questionnaires during the fall 1981 visit to 
each school district* Attendance data were sought only for those students, 
since some of the analyses involved determining relationships between student 
questionnaire items and attendance levels. Of the 13,737 students who filled 
out fall questionnaires, attendance data for at least one year were obtained 
for 8,376 students (61% of those who filled out questionnaires). 

Since objective attendanea^dita were" available for only a "subset" (61%) of 
the students who filled out questionnaires, the data bases used for the 
attendance analyses were reviewed to determine whether attendance levels in. 
the subset of students varied from the total student sample. Three data bases 
were examined in this regard: 



^District-level and student-level factors were about equally associated with 
the unavailability*^? attendance data. Attendance data were simply unavailable 
in 17 of the US school districts included in the sample, which included 2,473 
students who filled out questionnaires. Attendance data were not obtained in 
these districts because the data: \\) could not be released without violating 
school district policies concerning confidentiality; (2) were inaccessible or 
impractical to retrieve (e.g., records were kept in individual student riles by 
the student's teacher, often In several schools); (3) had been destroyed due to 
fire: or (4) on individual students for past years were not retained (i.e., only 
aggregated data, were available). Attendance data were unavailable for the re- 
maining 2,888 students who filled out questionnaires because: (1) individual 
student records were missing or had \been misplaced or (2) students had trans- 
ferred or moved out of the school district. 
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(1) Fall Questionnaire File: Includes program participation, attitudinal and 
related information based on responses to the Fall 1981 Studer^ 
Questionnaire by 13,337 students, 

(2) Complete Attendance File : Includes available attendance, grade level, and 
school district background (e.g* , size, location, etc) data obtained from 
school records for 8,376 Indian/Alaska Native students for: the school 

V years from 1977*78 to 1981-82- These students are a subset of the 13,337 
who filled out fall questionnaires. As the largest body ©f attendance 
data* this file was used- to calculate mean attendance rates for Indian 

students for comparisons with national norms* 

* - * 

(3) Merged Attendance File : Includes attendance* attitudinal, standardized 
reading and mathematics achievement test Scores, demographic 
characteristics, and school districts characteristics (size* location* 
etc) on students who" completed both the fall and spring student 
questionnaires, Almost all of the analyses presented in this chapter _ 
(except those involving comparisons with national norms) used the Merged 
Attendance File. 3 The 6,597 students in this file are a sublet of this 
file are .a subset of the two files previously described, 

In the Merged Attendance File, students- who attended 75 or fewer days of 
school were excluded from the analyses' for tJiat year. This was done because 
such low attendance suggested a transfer during the school year or other 
factor which could have introduced an artifact into the measurement of school 
attendance. , ■ 

To determine whether the subset 'of students used for the attendance analyses 
varied in attendance levels from the total student sample, the studepts in the 



Fall Questionnaire File were compared Iti^h the | 



tudents in the Merged 



3 It should be noted that certain analyses which were performed on the Merged 
Attendance File for this monograph were done instead 8n the Total Attendance 
File for the Final Report of this project,, Althoafti the overall mean on the 
Merged Attendance File is higher,, the pattern of findings on the two files is 
nearly Identical, ■ , 
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Attendance File on a self-report, five-point scale Item wh/ch askzred "How oftafi 

/ 4 

do you sttend school? 1 *" by selecting one of five categories* Me»n scores 

for bothn data files ai™~e quite similar- For grides 4-6, /the mean is 1.84 for 

both fines. For grides ME, the means for the Fall QJestionnaii — esfile and 
Merged attendance Fi Is are 1.68 and 1 .58, respectively. In addit=ion, s 
frequency distributioi — is for the two files show a similar pattern for both 
grades £4-6 and grades 7AU Thus, no mean 1 ngf u l^b i as Iseems to h^ave been 
introd cad at either ggride range when using a subset of all samplfed students* 



Students in the Comp lete Attendance File (M-SOIS) were also compared for 
possible differences Hn attendance rates with the subset of theste students, in 
the Merged Attendance File (N=6597) on the number of school days attended 
during ^he 1980-81 icl — tool year* The mean number of days attendiM by students 
in the Complete Attendance File was 162.4, compared with a mean of 165.2 for 
the subset of students In the Merged Student File, Thus* the meaen attendance 
figures for the Merged Attendance File are slightly higher tnan tefte Total 
Attend^rrice File, Mosm of the difference can be accounted for by the exclusion 
from thes Merged Attendance file of students who attended 75 of f^wer days 

(N^137) The mean foi — the Complete Attendance File when these sa»me students 

are excTIuded is 164, 1 — jl 



The attendance data wi 
* procedures. The trenc 
with various variables 
the days of attendanci 
result Mfi the mean da 
classification analy^f 
data p^tw student, and 
of the classification, 
by compyuter to produCi 



ire analyzed using Statistical Analysis Syst 
f lines were produced using the Summary proc 
i being used as the classification variable 
I in the years 1977 through 1980 were averac 
iys of attendance per year for the levels ol 
»d. This procedure al Towed maximum use of t 
ripresented the actual number of students i 
The means for each classification per year 
s the" actual trend line. The analysis of 15 
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:edure of S 
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Table \ 
it eaoti level 

wens plotted 
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time; 3 * 
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miss ab.out one 
than two days 



^ attend all of the time; 2 s attend/frTiQSt of the 



1 t , 

\ daya^week; 4 - miss about two days a m& 
a week , j y ^ 
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data incorporated the use of the SAS procedures General Linear Model, 
Correlation, and Regression to determines the relationship of selected 
variables with 1980 attendance of Indian students, 

The number of students represented in tr=ie various trend lines are presented on 
a graph illustrating the trend . These student data were assumed to be 
weighted appropriate]^ the sampling procedures used in the Part A Impact 
study, All analyses In this chapter used an Indian student as a unit of 
analysis- The large number of cases provided very high statistical power for 
finding statistically significant diffei — ences between means* In many 
instances, the .netric difference could toe very small while technically being 
statistically significant. For this reason, the findings in this chapter will 
focus on the trends and the metric differences existing in these data, rather 
than on the calculated level of statistical significance- 



C. Findings 

x 

The results of the analyses arm presented In sections containing a description 
of the findings and, generally, an illustrative graph. In each case, the 
graphs have the same vertical scale representing the number of days of 
" attendance per student. Except for the findings comparing Indians with the 
national mean, all students referred to are Indian students. Where multiple 
graphs are used to show al 1 classifications, a reference line is presented to 
allow comparisons among the graphs* 

National Versus Indian Attendance Trends 

Indian student average attendance levels were compared with national average 
attendance figures reported by the National Center for Education Statistics 
(NCES)* 5 The NCES attendance averages ■nave also been quite stable over the 
years. From I960 to 10, during which time NCES published average attendance 
figures for several (but not all) of ttm years, the average ranged from a low 

. L ■ * 



5 An attempt was made to collect district-w ide data on average dally attendance 
from the districts included in the sample - Many of tne districts had not 
compiled attendance data In a manner suit able for sucn analyses, however, so 
district-specific comparisons were i not. ma«*je, 
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of 159.5 days in 1974 to a nigh of 163.5 days in 1966, Thsere was no 
particular trend in these data either upward or downward, 

Although there are some differences in methodologies used by NCES and this 
study, and some problems Inherent in the data col lected fasr both efforts, the 
principle used for calculating average attendance figures is the same, Both 
studies divide an aggregate days of membership figure (i.e., total number of 
school days attended) by the number of students. There at — e two differences in 
methodologies. First, NCES uses aggregated data reported by states, whereas 
this study uses individual student data. However, the data collected by NCES 
are ultimately based uport individual students within the states. Second, NCES 
averages are based, in part* on estimates of enrollment o* aggregate days 
membership whenever states do not report data in the standard form. Any 
estimates calculated by NCES are based up^their past experience in gathering 
enrollment and attendance data over many ylirs, In brief « the NCES data 
appear to be comparable to the data in the study, since thne principle used in 
calculating average attendance Is the same in both. 

An examination of mean Indian student attendance levels, shown in Table 10-1, 
shows little change, varying from a low of 162,0 days In W 977-78 to a high of 
163*5 days In 1979-80. These figures are about the same eas, or slightly 
above, the national average of 161-6 days f^r 1975-76 and 160,7 reported for 
1980-81. 

Another attendance "noroi" was calculated to provide a mors accurate comparison 
of Indian student attendance levels with non-Indian norms— This norm was ~ 
calculated by: (1) multiplying the number of Indian students within each 
state for whom attendance datawere available by the stats average number of 
days attended, as reported by NCES; (2) summing the resulting numbers; and (3) 
dividing the sum by the total number of students. This norm provides a more 
accurate comparison because* (1) the only states included In this norm are- 
those wherf attendance data were gathered on Indian studemts and (2) state 
averages were represented proprolional ly in the calculations according to the 
number of Indian students for whom data were available, The" norm (mean 
number of days attended) calculated using these procedures was 161,7 for 
1980*&1, about one day above the national average reported by NCES* The 
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TABLE 10- 1 



AVERAGE DAYS Of ATTENDANCE REPORTED PER INDIAN STUDENT 
3ETWEEN 1977-78 Al*ND 1980-81 



School 
year 




Number of Dtys Attended 
by Enrolled Indian Pupils 


Estimated 
Days of 


National Mean 
Attendance** 




H*' 


Mean 


- Hindard ugviataon** 






1980-81 


3018 


. 102.4 


21,4 




161 


1979-80 


6930 


163.5 


19.2 




151 


1978-79 


6507 


162,7 


20.0 




161 


1977-78 


541S3 


162,0 


20.8 




161 



*There was c^msiderable attrition in the numiber of students for whom data were 
available f^om 1979-80, 1978-79, and 1977—78. This attrition resulted from 
data missincg from school records for ind/iwidual students for these years, due 
to student transfers, and from the unavalW ability of data for all students 
from several districts for tar Her years * 



**The standarcrj deviations associated with trte Complete Attendance File are 
larger than might be expected. This Is because of the Inclusion of a number 
of students with very low members of attendance days. When students with 
fewer than 176 days of attendance are exeluided, the standard deviations arm 
considerably reduced (1960-81, 15.7; 1979=80, 14,2; 1978-79, 13:8; 1977-7S, 
14,6)* 

***The most reczrent national average number of= school days attended per pupil was 
160.7 for 15=980-81 ; the average for 1975-7(3 was 161 ,6. An examination of 
previous years' national average figures published by NCE3 since 1966 shows 
little variation from those reported above, National attendance figures art 
presented ir^n annual reports publ 1 shed by the National Center for Education 
Statistics! entitled Digest of Education Statistics , 



Indian stydrant averages, shown In Table 1Q-1, are about the same or slightly 
above this i — lonru 



As a final comparison, average attendance rates fbr Indian students within 
each district were compared with the reliant state average, Districts were 
categorized according to how many days tfte^ir Indian attendance rate varied 
from the state average. In more than halP (SIX) of the districts, the Indian 
student av^r^age attendance rate was higher- than the relevant state average 
(see Table 6 04), In 27% of the districts- * the, average attendance rate was 
lower* ^. 
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TABLE. 10-2 

COMPARISON OF IND IAN STUDENT ATTENDANCE AJ^AGSSHTHIN 
SCHOOL DISTRICTS WITH STATE AVERAGE ATTENDANCE RATES 



Difference In Days Whan Overal 1 
Stata Attendance Average Compa^red 
with Endlan Student Average wi -thin 


Number of 

School - 

Districts 


Percent of 

$c fc*oai- - 

Oisterlcts 


Each School 01 strict ^ * 

Indians student attendance aver age 
more than five days below statue 
average. 


27 

* 




Indian student attendance average 
one to five days below state 
average, 


-> 


9 


Indian student attendance average 
from one day less to one day i*ore 
than the state average. 


ii 

* 


"1 1 


Indian student attendance average 
one to five days above state 
average. 


25 


26 


Indl^ri student attendance average 
more tthan five days above state 
average. 


24 


Si 


Given the methodological Issues Involved in data collection and analysis, it 
is difficult to draw firm conclusions concerning relative attendance levels of 
Indian students and the population as a whole. It does appear* howe-ver, that 



^csi an attendance is in the same range as that of the general popula-tion, and 
th-at Indian attendance rates remained relatively stablf fro 1977-78 to 
19SO-81. • •'*._ 

Th«*se findings contradict fche widely-held belief that attendance rat«9s of 
Indians fal l%ar below those of white students. Efforts we made t^o locate 
ot*ier research studies at tehe national level which compartc attendance rates 
of Indian and non-Indian students .Jhe most comprehenslyiricent steady which 
wa^s located (Coleman, 196SJ found attendance rates for Ifldjan-tt-uaen ts to be 
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identical to those far the population as whole (95% for elementary students 
and 93% for secondary students)- The results of the present study plus those 
of Coleman thus bring Into question the belief that Indian students have much 
lower attendance rates than other students. 

Indian Attendance Trends By geographic and Geocultural Region 

There are five geographic regions used by the Indian Education Program for 
administrative and functional purposes* These were divided by the impact 
study into 12 geocultural regions. Data on attendance by Indian students were 
analyzed using these geocultural regions- 



Table 10-3 shows the mean number of attendance days for Indian students in 
each of the geocultural regions* Reported attendance was higher than average 
in the following regions: The Southeast, the Northeast, Alaska, Oklahoma, and 
the Midsouth (Texas, Louisiana, Arkansas, Missouri, Kansas), Attendance was 
lower than average in the Dakotas, California, the Northwest, the Southwest 
(Arizona, New Mexico, Nevada, Utah, Colorado), and the Midwest (Wisconsin, 
Iowa, Minnesota), 

Indian Attendance Trends By Grade Level 

The longitudinal attendance data were analyzed by grade level using two 
approaches* First, the data were analyzed by categorizing the Indian students 
into two grade level groups: an Elementary Grade Level Group covering grades 
4-6 in 1981, and a Secondary Grade Level Group covering grades 7-12 in 1981, 
The grade level groups used in the first of these analyses were used 
throughout the Part A impact study for comparison purposes*" Since the 
attendance data were f^om 1977 to 1980, the grade level of the students was 
adjusted back to coincide with the atte^fance data being analyzed, while 
maintaining the same students In the groups . Therefore, the students In the 
Elementary Grade Level Group were In grades 3-5 during 1980, grades 2-4 In 
1979, grades 1-3 in 1978* etc, 

Secondly, the data were analyzed for changes in attendancfe by grade levels 
over the years where a grade level comprised a different set of students in 

■ ■ 181 
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TABLE 10-3 

MEAN INDIAN STUDENT ATTENDANCE BY SEQCULTURAL REGION 





- 

Region 


M 
n 


Mean Number of Days 

/1Q77-lQfiO Avpraae) 

\ 13/ /- I3QU nVE! QUE, 








1, 


Illinois, Michigan, Indiana, Ohio, Pennsylvania, 
New York, Connecticut, Rhode Island, Massachusetts, 
Vermont, New Hampshire, Maine 


DO 1 


IQQiQ 


2. 


Kentucky, Virginia, West Virginia, Maryland, 
Delaware, New Jersey, District of Columbia, 
Tennessee, North Carolina, South Carolina, Georgia, 
Alabama, Mississippi, Florida 


771 


169,4 




Wisconsin, Iowa, Minnesota 


"4T5" 


162.9 


4, 


North Dakota, South Dakota 

Nebraska, Wyoming, Montana \ 


174 


159,1 


5, 


133 


164.2 


6. 


Alaska \ 


187 


165.5 


7 e 


Washington, Oregon, Idaho . \ 


306 


160.3 


8, 
9, 


Cal iforp^a 
Arizona* New Mexico 


767 


161.9 


10. 


Nevada, Utah, Colorado * ^ 


43 


162.9 


11. 


Oklahoma 


1,567 


165.4 


12. 


Texas, Louisiana, Arkansas, Missouri, Kansas 


169 


165..1 




Total * , 


5,996 


164.5 '/ 



each successive year. These analyses focus on changes In attendance of a 
particular grade level over the years," given that the students in that grade 
change each year. J 



The grand mean for Indian students in all these analyses was calculated for 
each year, using attendance data for 6,597 Indian students reported by the 

- is r 



school districts. 
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Grade Level Groups - The Elementary Grade Level Group consisting of 3,289 
Indian students Improved in attendance between 1977 and 1979, from a mean of 

162.2 to ISS^Xdays (see figure 10-1), Between 1979 and 1980, mean attendance 
declined slightly to 165. 5 days, As this group of students increased in grade 
level, from 1977 to 1979, their attendaryfe improved. As the group Increased a 
grade level between 1979 and 1980, the mean attendance dropped slightly. 

The Secondary Grade Level Group consisted of 3,317 Indian students in 1980 
grades 6-11. Tnese students were In grades 7-12 during the data collection of 
the Part A impact study in 1981, This group maintained a virtually level 
attendance between*l977 and 1979, at about 166 days, Between 1979 and 1980, 
the secondary group mean dropped about 1 day. 

Attendance may vary within individual groups of students, as shown by the 
above analyses. However, attendance also may vary between the various grade 
levels over the years. The next four sections address changes rn attendance 
trends by grade level, with various students representing each grade over the 
years, The analyses will be discussed in groups of grades, w+fh the grand 
mean used as a common point of reference (see Figures l^^to 1 0-5) . -\ 

Kindergarten to Grade 2 - The only year In which data were available for 
kindergarten students was 1977, the earliest year reported frr 1980 third 
grade students* In 1977, the kindergarten students had a mean attendance of 

158.3 days, This level was more than 5 days below the grand mean of Indian 
students, ^ 



Grade 1 data were available for tne years 1977 and 1978, There was no change 
In the attendance trend between students in grade 1 in 1977 and those in grade 
1 in 1978, Grade 1 student attendance, on thejyerage, was slightly over 4 \ 
days higher than that of kindergarten studertts,. Grade 1 mean days of ^ 

attendance was 1 day below the grand mean In 1977 and more than 2 days below 

i 

the mean in 1978. 

The attendance trend for students in grade 2 was level over the three years of * p 
available data, 1977, 1978, 1979, at slightly over 165 days for each year. 
Tins level was above the 1977 grand mean by about 1 day, but below the grand 
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ATTENDANCE BY 1980 GRADE GROUPS 
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FIGURE 10-3 

MEAN DAYS OF ATTENDANCE BY GRADE 

FOR YEARS 1977, 1978, 1979, 1980 
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mean In the years 197f; " fhe rand mean had Increased slightly In 
those years, while t th^ neem for. ^ . was level." * ^ 

- . ; r m , 

Grades 3 to, 5 - The ffrtanw *nc* treuid for grade 3 students Increased from 1977* 
to 1978 by almost 2 eg** . Fn* ■» 197ft to 1980, there was 'a steady but slight , 
decline In mean atto^Mnya *-p* ?* vdents in grade 3. The level of attendance 
was very cjpse to th<s g?r#ral immi 9 iJeing 165.3 days In 1980. 

* * * m 

Students In grade 4+ w» • ^wat 3 days above the grand mean In 1877, They 
maintained a mean ©f* afaaut 1*7 days 1n 1978. From 1978 to 1980, grade 4 
students declined in tfttttdance to a point virtually 1dent1eal-w1th the granl 
mean, In both 19F9 and 1980, \ 

Grade 5 students maintained a level attendance above the grand mean, at about 
167 days for all years between 1977 and 1080. ^ 

Grades 6 to 8 * The students in grade 6 In 1977 through 1980 maintained an * 
almost level attendance trend; Just below 167 days for each year. 

^ ..-* * 

. - ; * - 1 " / i ' ; ' ■ 

The attendance of grade 7 students In 1978 was lower than grade 7 students 1n 
1977 and 1n 1979, In I960, €tk attendance of gra^e 7 students leveled at just 
over 166 days* . " , 

n 1*977, tme grade 8 students were above the grand mean by £ days. In 1978, 
>they were barely above the grand mean, having declined about 1 day while the 
grand mean had ^Improved, Gradr 8 students in, 1979 declined slightly more, to 
a point 1 d£y below the gfand mean* .. The 1980 gradr 8 studentr also declined 
slightly from the, 1979 level t to 164.5 .days 1n 1980. about one-half day below" 
the grand ipean- 

? f ." r ■ : I \ • _ , . • 

Grades 9 to 11 * Three years ^f data were available for grade 9 students. In 
1978* these students were 2 days below the grand mean* ' s The grade 9 students 
1n 1979 had a nlghei* level of attendance, belPig on the grand mean at 166 ^ 
days* In 1980, grade 9 students Were almost 1 day above the grand mean, at 
165.9 days* , . .... .V. ^ i ■/ 



ERIC 



There were two years of data available for the grade 10 students* In b»oth 
1979 and 1980, tfce grade 10 students were about 2 days beliw the grand mean. 
The 1980 grade 10 students had a sightly lower mean attendance than die* their 
f counterparts-- In 497l9^.hay.ing^ 

line. ^ * . 



There war a single yfar of data available for the* grade 1titydenfcs;^tbjBese 

students were in grade 12 during the data collection in 1981 The meana days 

of attendance for grade 11 students in 1980 was 159K. Thjll level was 5 days yj 
below the grand mean for 1980. • ' - • 

Summary - The attendance of Ind/Un^students generally' increased fr-qm ^ 
kindergarten through the* fifth and sixth grades. The fits of increase was | 
greatest in the lower, grade's, and decreased with suGcess1w»tjradeis Woaugih g 
grade 6. Attendance ^as -fairly stable and high f rom grad% 6 thrdiagh gi™ ade 7. v| 
There was a loss, in attendance of about 1 day in .grade B, sdilch-was recovered S 
, In grade 9. Then, from^rade 9. to grade 11, there was a i^of about 3 days ? 
per grade level. *• . • ■ , :'■ -^::S l % 

Indian Attendance Trends fey Locatiolt %pe • ^ 



The school districts Included in the Part A Impact s«udy>srt In variouas rtypjs 
of locations; on or near reservations, a rural locationl eilit rarai 
locations: urban locations; and metropolitan locations, 1 'vfc 'urban alr»as. • -" 
The attendance trends of Indlan.students were 'calculated ^ ii]iaij^ed.f^r eac 
of these Ideation typfs./ :? 7 / /^* : " '. ' : *:V-.' \? *M' 

Ftgure 10-6 1 llustrates the trtnd lines f or Meh of th# "iwftji9n-/^yP^?>". :, across 
the four jears'of 1977, ,1978* 1979, and J 980.' the grati'd Win' of the Ii^lan^ 
students /1s plpttfed on the graph as k refirenca. 11na v ^ * ^ ^v|s 
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ATTENDANCE BY LOCATION TYPE 



OHfli RURAL 



URBAN 



IKS 



it 



!l*lii«IMtiiMi«$iHM 



175 



180 



111 

159 



c 





.'. .**'.' : .".v. 1 '-'"^ - R 



\ " ' 



1 .1 




10-20 



tropolltan and other rural school attendance waeans incr eased in ^ ] 978, as die! 
he^grand mean* But other rural increased, at- tlwe greater rate, _a»d exceeded* ^ 
h% attendance level of tHOitropoTit an schools j^jySoufcdnte-'ta^ 
ur a 1 schools were about 1.5 days abovr« tJie^ gr^n^d mean * Other rui"*al schools S 
ontinued to Increase^jfrom T978 to 1S79, »at a si I ightly reduced ratze, to a ". 7^ 
evel 2, ^ days abtSv^the grand mean.' They deeli ined si Tghtly between 1 979 arid ;V| 
980 t J)ur maintained their relatively high position. 



rhe metropolitan schools declined -in mean atteri<£Banci f rom 197S to 1979, tOi.a^g 
joint slightly below the 'grand mean* The metropolitan sehools wer^a at the - , g 
rand mean In. 1980. *^ * - • * ■ 



he urban school locations had an attendance tr^nd that, closely f<m 1 1 owed the 
rand mean trend ^and was approximately 1 day or less below (t f or =all four - 
ear^. In 1980, the urban attendance level was just below the graarid mean- t 
vefall, the students 1h urban schools had a ye^ry gradual. Ifldrfeastt 1n v 
ttendance between 1977 and 1980,; 4 . -\ ; ;"v;; r 



Vhf Indian students attending school s_5n^dlsi;ric=ts on or near Indfi in 
r-r-eservations had a 1977 mean days .of attendance sljght.ly below th&ir urban 
counterparts, at just above 163 day£ par year. They were ] day bifetbw the 
grand i mean of Indian students, The attendance' .t^refld. intreu^{V«_!^y .sl.fgfttjjrf: 
ffroni 1 977 to 1 978, at which point the on. or nea»»~ reservation schoo*ls were 
si 1 most 2 Jays below the grand mean. .Frqrn 1978 fehrough .1980, the o*n or near 
r—eservat Ion school attendance trind dec! ined t^ point 2*5 days l^elow, the 
irand mean of 1980* '• ■ . v 



4 



[ndlan Attendance Trend by School Population QW[ms .ity o-f^ Indian St indent 



The schools 1ri the sample varied by the de&rp'e o^^denslty of the Cndlan ^ ^ 
student popu 1 at 1 on - Defisfty, tht proportion of Indian students to«r the totalK 
pDopulation In the school . ranged from 1 ess than IX to IQpX Indian ^opulatjori|| 

......... . - , ,. , 



F^lgurk lb-7 11 1 ustrates the attendance trends fo*»r four - categories iof densi 

ST9I 





The schools with low density", under 5£, and, thesi.wlth high d< 
had the highest mean days^ of attendance. The scnools with W 
density, 5-20%, had lower mean days of att#n§Wf8 then did sei 
lower or higher densities. This overall vjlltjf pattern exist" 
years. , • 



snsity, over 70%, 
termed late 
lools w1th*either 
id during all 



*rhe schools with low density, under Jifc, h4d attiitiance lavels 
- above the grand mean fry about 1 day, and gtneNlly followed ti 
grand mean. 



consistently % 
le pattern of the 



The schools with high density, over 70%, were above th*, -grand mean, 
except for 1979 when they were slightly MllQtf the grand Mean- y Between 1979: 
and 1980, these schools increased in mean att Manee • level, wMjile the schools 
under 5% density declined in mean attendance, ■• ; ; m '\ M<jk 



m 



The schools with 5-20* dens'lty and those with M0$ density -«ach had mean ^ 
attendance slightly below the grand mean 1n l&IJind 1978, TShelr trendf J. 
coincided during these years. The trends dlv%rpd in 1979,; w*-Hth schabls with j 
the higher density, 20*70%, Increasing in mm ittandanee to —a point above the w 
grand mean, and schools with lower density, 6-2»,.dec1 ining "to a level 1.5 ' ; 
/Idayi below, the grand jnean. -Both types of schools declined in^jttendance : ■ g 
■ between 1979 and 1980, but maintained; their ffelitjye^oiitlotes. In 1980, only ^ 
schools with 5-20% Indian density Vernal nefl^rvlit'e grand j&n at i livel of ti 
163 jiays attendance, per student. 



^'ifndianj Atte'iii'ciarifee^TrencIs by School Dfstr1ct_ltij . 

' Jlierfchobl, dlstrlctsVvarled b ^ overall* stMd4fic population - frwira^ery small 
• v ^iitr1cts to tHose* wjth over 200, 000 -studsflt^ The attendan^^ trends 'o^Q 
>^niia^s$de^&^^ 



:^^p ^ *M -to that^ 

students :\ a valley with both very ; small ^ 
: haV1^ 

ZsUk. : For all years, the smalt schbql ^isthJefe,, feWer;than ~ 573 students^ 
v,those with 3*246+ children (two.caiegorles) we« sbaye |he gr— and mean^if^ 

■7 . : ' ' \ ' • i"'r'\i*' : . ' ' ' ■»• '-' 

... . >'.;-, \ • - ^ , . , ' ■ , 
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districts with 574 to 3,245 students (two categories) were below the grand 

mean, ' ■ ^ 

* - - 

n * 

Indian Attendance Trends by Sex of Indian Student 

i 

There was almost an equal number of male and female Indian students for whom 
attendance data were reported by the school district! 48% male and. 52% 
female* Male Indian^ students w^re slightly above the female students: in 
attendance level for all Tour years. ^ The difference In attendance levels of 
the two groups is less than 1 day per year, ' c 



Indian Attendance Trends "by Soeioeeonolfti^^Statu^ of Indian Student 

The socioeconomic status "(SES) 'of *fhe* Indian student was estimated by whether 
or not the student's school lunch was subsidized. SES and attendance data 
were reported for a total of 3*143 students. Of these students, 70% had 
subsidized school lunches; 30% did not. 

.V ^ \ . .. •■: ;•-> • •; > ~ 

The attendance trends for ^tget%^tudents were compared with the grand meaij 
calculated on all students with . avai 1 able attendance data,. 6,697 students." 
Figure 10-8 illustrates the-relatlenships among the^rsnd lines-- The students: 
with sutfsMlzed school lunches, low SIS, were cons 1 stent lytower in attendance 
than were "students with .unsubsidiied lunches, high SE5U The difference was 

less in 1980 than in earlier years. ' . * . ■ >^ 

■ - - } ' " - . . f . ----- 

The students with unsubsidized lunches were 1 to 1-5 days above the grand mean 
In all foqr year© Students with subsidized lunches were slightly below the 
mean in 1977, 1978, and 1979. in 1980, these low SIS students were slightly^ 
above the 1980 grand; mean calculated on all available Indian student * 
attendance data for 1980. V „ # 

Indian Student * Attendance Trends by Hours of Project Effort Per Student Per 
Year fin Improving Attendance Sj A 

\ / ■ * , . - ' 

I = * - , 

The P^rt A projects varied in the extent of effort expended,* in the ybar 1 981 , 
In attempting to Improve the attendance of Indian students.* The extent of 
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effort was measured by the reported average number of hours per student per 
year applied in improving school attendance* These data were merged with the 
attendance data for the Individual Indian student* The mean attendance trend 
for students with zero hours of attendance effort was calculated and used as a 
reference line* rather than using the grand mean trend line. Using the zero 
line permitted comparison among student attendance in projects with_.various 
levels of effort and students in the projects with no effort applied* 

There were 2,926 Indian students in projects with zero effort applied. The , 
attendance tPMfiLfif these students^over thfr four years was plotted on Figure 
10-9 as a solid line* The trend line for these^ students follows the grand 
mean trend very closely, The trend lines virtually coincide in 1980 and 
1979, The grtpd mean is about one-half day lower In 1978, and 1 day lower in 
19177. 

* ' 

The projects were categorized by the number of hours of effort applied per 
student per year in Improving attendance. The trend 1 ines for the categories 
were plotted In Figure 10-9. V ■ , 

The students in projects In all ^buf ona category of hours of effort had 
attendance trends Indicating a lower level' of attendance in the years 1977 
through 1979 than did the students in projects expending zero eTfort on. 
attendance* In .other words, projects that had students with relatively low . 
attendance in the years 1977 through 1979 expended effort on Improving 
attendance; projects with relatively high and jstable attendance (mirroring the 
grand mean) expended zero effort* 

The projects reporting ^21 ^40 hours of effort per student deviated from the 
pattern. The students In these projects had attendance levels higher than did 
students In projects applying zero effort* However, these students had a 
trend of declining attendance" from 1978 through 1980, although the actual 
level was relatively high in all three years. T 1 projects seemed to^ 
respond to the decline in attendance with an application of 21-40 hours of 
effort per student, on the average, to brirflj attendance back up to the level 
of earlier years* 



FIGURE 10-9 
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Among the projects with low attendance levels in the years before 1980 t * 
projects expending 1*20 hours of effort had students who had tended to 
Increase attendance between 1977 and 1979 f but had declined in attendance 
* between 1979 'and 1980, In 1980, the students in these projects were about 1 
day below the reference line and the grand mean* 

Projects that expended 41-80 hours of effort on improvlngx attendance had 
students who tended to improve their attendance each year* at a slightly 
decreasing rate, from a level 4 days below the refe^iice group in 1977 to just 
. above the reference group end the grand mean in 1980* 

# * 
Projects that devoted 81-160 'hours had students who had declined sharply in 

attendance from 1978 (the earliest data available for these students) to 

„ 1979* 1 Their 1979 level was 6' days oelow the grand m^an and reference group, 

between 1979 and 1980* there was a sharp increase In the attendance of these 

student^, to the f^Vel of the grand mean and of the, reference group, 

projects that expended 161 or more hours (up to severaT hundred hours reported 
per student per year) had students who had steadily declined In attendance* 
from a point just below the reference group in 1977 to a level about % days 
below the reference group inM979- These students showed a very slight 
improvement between 1979 and 1580, but were still a full day below the 
reference group and the grand mean, 1 \ j . 

Attendance Trends by Proportion of Project Effort to Improve Attendance 

Expended During the School Day .■ ,\ 

» ™ - — - - ^ _ 

The Part A projects varied in the proportion of the effort to Improve l 
attendance of Indian students that was expended during the school day, The 
proportion expended during the school day was reported by the projects t 
reporting more than ztro hours effort in improving attendance*, 

Jhere were 2,926 Indian students in projects with zero effort expended, The 
^attendance trend of these students oyer the four years was /plotted on Figure 

! " * ■ ft 

10-10 as a solid line. 
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The remaining projects were categorized by the proportion of the effort 
expended during the 1981 school day, The categories Included projects that 
^expended all of the effort after school hours. The remafning categories 
represented proportions of t^fort expended during the school day. 

Projects that worked 100% after school had students with the highest 1980, 
attendance level, 2 days above the reference group and the grand me.an. These 
students had been above the reference group since 1978, They had- Increased 
their attendance from 1.5 days below the reference group in 1977 to about 1 
day above the deference group in 1973, 

ProjeC/ts which expended a'small amount of the total effort during the school 
day, 1-25%, had students who were very similar to the projects that worked 
exclusively after school, Thes^ students had been aoove the reference group 
since 1979. In 1978, they coincided with the reference group, having Improved 
sharply in attendance between 1977 and 1978* Overall, these jstudents had 
Improved their attendance between ,1977 and 1979 and had maintained a level 
attendance between 1979 and 1980, In 1980, they were almost 2 days above tne 
reference group, ^ 

Projects that worked 26-50% during the school day had students who had 
declined stfarply from a relatively high attendance level in 1977 to appoint 2 
days below the reference 'group in 1978* These students remained at least Z 
days below the reference group In 1979. Between 1979 and 1980, they improved 
to a point about 1 day above the reference group. 

The projects th^t worked on Improving attendance 51-75% during school had 1 
students who were consistently two or more days below thk reference; group in 
all four years* In 1980, these students wire 3,| days^below the* reference 
group and had declined about 2 days from their 1979 attendance level* 



on 



The projects that worked between 76% and 100% of %he time during scfiool 
improving attendance had students who were 4 to 5 days below ^the ^reference 

. group and the grand mean. These students had maintained the lowest level of 
attendance of all categories through all four years. In 1980, these students 

* were 5 days t^elow the reference group and the grand mean. 
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The pattern of these trend lines indicates that projects expended more of 
their effort to improve attendance during the school day as the severity of 
the attendance problems increased- When students attended at a relatively 
high level over a period of years, the, project expended effort after school to 
maintain or improve attendance levels. When student attendance trends were 
low over a period of years* trie projects' tended* to^work during school in 
efforts to* improve attendance. The percentage of time spent during school 
increased as the attendance level of the students . decreased* 

r , 
Parent Reports of General S atisfacti o n with the Project 

r~ — — — 1 ~ \ ' 1 . 

p The Part A impact study interviewed parents of Indian children who 
participated In the Part A project In the school districts. The parent 
responses In regard to general satisfaction with the project were averaged by 
project and Merged with the Individual Indian student data; The relationship 
between the Parents' Report of General Satisfaction with the Part A Project 
4nd 1980 days of attendance was analyzed for S,363 Indian students. There was 
a small but statistically" significant 1 positive correlation of .11 (p 4 .001). 
As the parents 1 general satisfaction with the project increased, »t he 1980 days 
attendance of Indian students also Increased. Although there was only a weak 
relationship between the parental variables and the days -of attendance In 1980 
(r 2 x # 013, F * 37.4, p < .001), the parents 1 report of general satisfaction 
was found to be higher for students with high attendance in 1980- than for 
students with low attendance in 1980* 

r t 

Parent Perceptions of School Personnel Sensitivity Toward Indians 

¥ The parents interviewed were asked about their perception of the level- of 
sensitivity displayed byl various school personnel toward Indians. As the 
1 percept i on o F sens ttivity increased, the days of attendance In 1980 also^ 
s 1 itereased (r ,« .06, p < 001 ) ." However, changes 1n thp 3 ; we>Nrfp^^ 

sensitivity of school personnel were associated with a Itesser cfknge'ln 1980 S 
attendance than were the changes in parents' -general satisfaction. ^Schools In 
which parents perceived high sensitivity and In which the parents wereN(^ .jig 
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satisfied with the Part A project tended to have students with high levels hf 
1980 attendance* • 

s 

Indian -Student Standardized Math Test Scores * 

Standardized tes^ scores were made available and collected for 2,794 of the 
students for whom- there was attendance data reported* There was a small 
positive relationship between the standardized math test scores and 1980 days 
of attendance of the Indian students (r «-.07 9 .p.-< •001)* The math scores 
were analyzed in a multiple regression procedure that controlled for the 
effects of reading test scores and'SES of the student, The net effect is an ^ 
increase of -07 days of attendance for each standardized unit Increase in math 
score* 

! , * 

Indian Student Standardized Reading Test Scores * .< 

There was a small positive relationship between the standardized reading test 
scores of 'Indian students and their 1980 days of attendance (r * -07, p < 
-001)- . The multiple regression analyses controlled for ttie effects of the ; 
rij^rth test scores and for SES of the students* The net effect was an Increase 
of * OS days of attendance for each standardized unit Increase in reading 
score, The math and reading scores ware standardized on the same scale; 
therefore, the effects are! comparable, Math test scores had slightly 
greater relationship with 1980 days of attendance than did the reading 
scores* Overall, the test ; scores and 1 * SES were very weak predictors of 1980 / 
attendance* They explain less than 1% of the variance In 1980 days of / 
attendance* ! - * / 

i . < \ * 

Analysis of Attendance Sains for the Student Group with Low Attendance In 1979 
^ : — j ■ — — 

The longitudinal analyses considered all students as a group. The total group 
was shown to have a relatively high level of attendance on the average* To' 
assess the Impact of Part A projects on students who were particularly in need 
of help in Improving attendance, an analysis was conducted on a subgroup of 
the total student group* Students with attendance of 150 or fewer days in 
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1979 ware classified as the Low Attendance Group, This Low Attendance Group 
contained 386 students, , * 

The Low Attendance Group was divided into two classification^ a Successful 
Group, which had a gain of 15 or more days between 1979 and 1980, arid an 
Unsuccessful Group which had fewer than<15 days gain. The difference of 15 
days would bring a student with an attendance of 150 days in 1979 up to the 
grand mean of 165 days in 1980. 



Four groups were .compared in the analyses: Unsuccessful Group, Successful 1 > 
Group, Total Low Grotip, and Total Students, The differences among the groups 
are presented In Table\10-4. The mean difference on attendance days between f 
1979 and 1980 for the Low Attendance Group was much higher than that* of the 
Total Group, indicating that, overall, these students had tended to improve 
attendance to a greater extent than had the average student- This difference, 
however, could be at least partially accounted for by regression to the mean. 
Of the Low Attendance Group students, those in the Successful Group had a very 
high mean difference of 36.l!days, while the students in the Unsuccessful ■ 
Group had a mean loss of 2*7/day^\between 1979 and 1980, The Successful- Group 
represented 46% of the Total Low At^endence Group. 

, ^ • • ' V " • \ ; . .; • 

TABLE ^0-4 ~ — ['J 

. HOURS OF PROJECT EFFQRT\TCP IMPROVE ATTENDANCE t; . ••• ~4 

MEAN DIFFERENCES IN DAYS BETWEEN ,1979\ AND 1980 AND MEAN HOURS OF EFFORT 

EXPENDED.\r981 ' 



Group 


N 


Unsuccessful 


■ i 

207 • 


Successful 


„\ 


Total Low Attendance 


386 


Total Students , 


V 4516 



Mean Days" 
of Difference 



•2.7 Days 



214 




Hours of 
Effort -toy 
Project j ^f 

25.5 Hour*' 

45.7 

35.0 

25.0 
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Differences existed among the mean number of fiours of effort expended by the 
Part A prdjects during 1981*82 to Improve attendance rates, Projects serving 
the students dh the Successful Group expended a much larger mean number of 
hours on improving attendance than did projects serving the students In the 
other groups (see Table 10-4) * The projects serving the Low Group, on the. 
average, expended about 2,2 hours more per student per year than the average 
for all students, Projects that served the Successful Group expended 45,7 
hours of effort, compared with 25,5 hours by projects tnat served the 
Unsuccessful Group. . _ w 



The causality of this relationship is .compl icated, however, by the fact that 
the Information about project effort was collected for a period 1-2 years 
after the data on student attendance, If project effort on , attendance is 
relatively stable across years, these data may indicate that projects with 
intensive special programs were successful in improving the attendance^cf low 
attending students. The number of stu?#flt$ who showed improvement Is * 
extremely small, however, (4% of the total group) 



(4% of the tot an 
sfu-LJirdup were - 



The students in the Successful.J#Oup were sorted by grade level and the 
location type of their school district. The percentage of students in each 
classification for the Successful Group was compared to the percentages the 
Total Low Attendance Group. Table- 10-5 illustrates tne percentages of 
students by grade level groups. The students In Grades 3-5 comprised 65% of 
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,- TABLE 10-5 . . 

PERCENTAGE OF "STUDENTS IN SUCCESSFUL AND TOTAL LOW ATTENDANCE 

. GROUP BY GRADE LEVEL 



215 



Grade 
. Level 


Successful . 
Group 

N ' % 


N, 


Total 

Group 

%' 


. Successful Group 
Total Difference 
In Percentage 


Grade 3-5 


116 


65% 


227 


59% 


+6% 


Grade 6-1^ 


' v63 


35 


159 


41 


-6 • 


Totals 


, 386 


100% 


* \ 386 


' 100% 


r 1 



10-34 



the Successful Group. In the Total Low Attendance Group, these students 
represented 59%. The; elementary grade level group was thus overrepresented in 
the Successful Group, 



Table 10-6 illustrates the percentages of students by location type of the 
school districts attended, In the Total Low Attendance Group, 21% of the 
students attended rural, non-reservation schools- But/ the rural students 
comprised 26% of the Successful Group, The rural projects were thus 
particularly successful in increasing attendance for this group of students, 



TABLE 10-6 , 

PERCENTAGE OF. STUDENTS IN SUCCESSFUL AND TOTAL LOW ATTENDANCE 
GROUP BY SCHOOL DISTRICT LOCATION , , 



Successful 
District Group 
Location N % 


Total Low 
tendance Group " 
N % 


Successful Group 
total' Difference 
1 n Percentage 


On/near 'reservation 96 53% 
Other rural '46 '26 
Urban 19 11 
Metropolitan 18 10 

Totals ^ 179 \QC%) 


• > 217 56% 1 
80 21 
42- • 11 
47 12 

386 1 100% 


-3% 
+5 
0 

V -2 

\ ' ' - ■ 

{■ 

1 - • ■. 



D. Summary 



pve provide evidenc^ thpt 
ie range as attendance off < 



the attendance of ^ 



other students in > ^ 



The data presented and discussed ab 
Indian students has been in the same rang 
most^ areas of the, United States, There are certain areas 
attendance, especially the Dakot as, the Southwest * and California'. The 
eastern United States had high attendance compared with t|e other regions 



with below average 



Grade level of Indian student was a major factor in attendance. When students p| 



\-4 



began school, attendance was low* It improved to a stable and relatively* hjigh ~ 
level; during the middle school years, The secondary levfel marked the 
beginning of a decline 1n attendance, ? 
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The attendance of Indian students varied by the location type of school 
district. Reservation schools; had the lowest attendance; other rural schools 
ha^ the highest attendance. The size of the school district and the density 
of th^Indian population were shown to be 5 related to Indian student attend- 
ance* A valley-shaped pattern existed in which very small and very large 
school districts had higher attendance rates than did those of intermediate 
size or density of Indians.*** 

There was very little difference between the sexes with regard to. school 
attendance. A difference did exist between students with subsidized and 
unsubsidized lunches: students with subsidized lunches had a lower attendance 
than did those with unsubsidized luTfChes. ' 

The perceptions and reportr of Indian parents were related to 1980 school 
attendance of Indian students* In school districts where Indian parents 
reported high satisfaction and 'high sensitivity of school personnel to 
Indiag£, the 1980 attendance tended to be higher than in districts With low 
satisfaction and low sensitivity reporte&^by parents* , Standardized math and 
reading test scores were related positiveTjNto 1980 attendance* However, none 
of these relationships was capable of explaining more than a few percentage 
points of variance in 1980 attendance of Indian students. 

f * • 

The hours of effort expended by a project to improve attendance was related to 
the attendance trend of the students. \ /The\ pattern was complex, as discussed I- 
In detail* The proportion of effort to- improve attendance expended durJrig the 
school day generally increased with the severity of the attendance prob ferns of 
the school district. 



Whfen ^students with low attendance in '197 



'were studied as a separate group, 



the impact of Part A projects became somewhat more clear. Students with gains 
of 15 or more days in attendance between 1979 and 1980 were served by projects 
that provided more extensive effort in improving attendance in 1981-82. The 
J»art^ A_pcojects- i^i^rarf ^nom-reservat i an areas appear to have been most 
effective in improving attendance of low attending students. The projects 
improved the attendance of low attending elementary^ students more effectively 
than they improved attendance of low attending secondary students. 
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CHAPTER Hi RATINGS BY TEACHKS; STAFF* AND PARENTS WlfH RESPECT 
TO PROJECT. IMPACT ON STUDE^ ATTENDANCE 

G, Mike Charleston and Paul Hopstock 

Introduction * ■ - 

In addition to the data on Indian student attendance collected from school 
districts and reported In Chapter 10, the Part .A impact study also collected 
information on Indian student attendance from teachers of Indian students, 
Part A project staff, and parents of Indian students. These respondents 
answered a survey item regarding the extent to which the Title IV, Part A 
project had helped to improve attendance of Indian students in the school 
district. The response categories were: not at all, a little, some, and a 
great' deal* 

The data provided by the. teachers, staff and parents were analysed to 
determine the average level of impact on attendance within projects reported 
by the three groups* The levels of Impact reported by each respondent group 3 
were analyzed by: ^ - 

• Location of the school district; and : 

• Average hours of project effort per student per year spent on Improving 
attendance, 

* * ,- » * 

Also, the "level of Impact as reported by the respondent groups was compared 
with the actual attendance trends of elementary and secondary students. These 
comparisons made use of the school district attendance data described In 
Chapter 10- r , 

Procedures - . ^ 

Responses were collected frdfh teachers of Indian students in each project* 
The responses of all teachers were averaged within a project to provide a mean 
rating of impact on attendance from the perspective of the teachers of Indian 
students in each project* The same process was performed on the responses of 
thi staff and parents of Indian students to provide ^a mean rating of impact on 
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attendance from the perspective of staff and parents in each project, These 
ratings on the level of Impact were merged with project descriptive 
Information for each project and with the attendance data on individual 
students- There were valid teacher, staff, and parent data available for 101 
of the projects included In the Part A Impact study Sample* Some Wo jects In 
the study sample were missing data from one or more of the respondent groups 
and were excluded *frbm these analyses. 

The data used in all of the analyses of reported impact levels were . 
unweighted. The teachers represented In the data for these projects were not 
Intended to be representative of all teachers oF - *" Indian students. However, 
they do represent the regular classroom teachers of Indian students in the 
Part A impact study's sample, Thus, they are. an excellent sample, of 
experienced teachers of Indian students who are knowledgeable about, but not 
directly associated with, the Title IV, Part A projects. The parents were the 
parents of a sample of students. They were selected so as to preserve to some 
extent the self -weighting properties of the student sample. Project staff 
data were collected from key Part A staff working half-time or more in each 
project represented* Although these data could be weighted to estimate the 
population of Title IV, Part A staff, they were left unweighted 1n these 
comparisons with other unweighted data. The weighted means for the staff 
varied only slightly from the unweighted means used In these analyses, 



The data were analyzed uslng^tatlsticjr Analysis Systeir (SAS) proce 
The SAS Summary procedure was used to calculate the means by various 
classification variables, and statj,£4rtcal tests were performed using the 
General Linear Model (GLM) and 1 Correlation programs. <** 

Findings ' * 
Teacher Reports of Impact on Attendance . 

There were 1,307 teachers surveyed as part of the Impact study. Of these, 867 
(661) responded to the Item regarding project Impact on attendance of Indian 
students.^ Overall, the teachers in the 101 projects rated the Impact of Title 
IV projects on attendance at 2.83 on the assumed Interval scale of 1 to 4y no 
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impact, a little, some, a great deal). The distribution of individual teacher 
responses is illustrated by a pie chart in Figure 11-1 . As can be seen, most 
teachers rated the project as having some (45%) or a great deal (31%) of 
impact on attendance. Relatively few teachers rated the project as having a 
little (12%) or no Impact ( 12^) * 

To perform project-level analyses, teacher responses were averaged within 
projects and mean project rating was obtained* As expected with such a 
procedure, the mean project ratings were more closely grouped around the 
overall mean rating than were the individual teacher ratings, Approximately 
three-fifths (60%) of the projects had mean ratings between 2.5 and 3.5 on the 
scale of 1 to 4. Throughout the rest of this chapter, the results for 
teacher^ will be presented in terms of mean project ratings. 

Staff Reports of Impact on Attendance 

There were 413 Title IV, Part A staff members surveyed in the impact study. 
Of these* 381 (92%) responded to the Item about the impact of the project on „ 
student attendance. Overall, the staff In the 101 projects ^ated the impact '" 
at 3.14 on the scale of 1 to 4. Figure 11-2 Illustrates Lfto distribution of 
staff members on this question, m 

As the figure illustrates, half (49%) of the staff members rated the project 
as having some Impact, and an additional 39% rated the project as having a ;A • 
great deal of impact. Relatively limited numbers rated the project as having 
a little (9%) or no Impact (3%) . v ^ j 

As with the teacher ratings, staff ratings .were averaged within projects, and 
the mean project rating was used in subsequent analyses. Also as with 
teachers, approximately three-fifths (59%) of the mean project ratings for : 
staff members fell between 2.5 and 3.5 on the 1 to 4 scale, 

Parent Reports gf Impact on Attendance J . : 

There were 1,543 parents interviewed in the data collection for the impact 
study. Of these » 1,197 (78%) responded to the question about the impact of 
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the Part A projects on attendance, Overall, the parents in the 101 projects 
rated the impact of the projects on student attendance at 2,42 on the scale of 
1 to 4* The distribution of responses -.is IHustrated in Figure 11*3, 

■j j 

As illustrated, parents had a broader range of opinion than did teachers and 
staff members. Approximately one-third (36%) of parents rated the project as 
having no impact, but a third (31%) also rated the project as having a great 
deal of impact. The remaining respondents reported some (22%) or a. little 
(10%) Impact on attendance, . 

When parent ratings were averaged within projects, the mean project ratings 
fell near the center of the scale. Almost half (44%) of the" projecW had mean 
ratings between 1.5 and 2*5, and over a third (^38%) had mean ratings* between 
2,5 and 3.5. 

Over all 101 projects* the staff rated the Impact significantly higher than 
did the teachers. The parents rated the projects signf ic^antly lower than did 
either of the other respondent groups (F-27-40, df =2/291 , p < .001). 

Reported Impact by School District Location 

The reported level of Impact of Part A projects varied by the location type of 
the school district (on or/near reservations, 38 school districts; other 
rural,' 29 non-reserVation school districts; urban, 13 school districts; and 
metropolitan, 21 schoOT districts). The variation 1s Illustrated In Table * 

n-i. . . ' V; ; '-. ; ; " ' ' ■ 

A test of differences among groups indicated that projects in metropolitan ; 
areas were rated as having significantly less Impact th$n projects' on or near; 
reservations or in other rural areas* This difference Was found for all threes 
types of respondents, 4 -I 
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TABLE 11-1 

MEAN IMPACT RATING ON ATTENDANCE BY TYPE OF SCHOOL DISTRICT. LOCATION* 



- 


j 5taTT 


I iicnera 


rdren 


Location Type 


N Mean 


Mean 


Mean 


On or near reservation** 

Other rural 

Urban 

Metropolitan 


— . 15 

38 3,25 
29 3.25 
13 3.04 
21 2.83 


2.97 
2.96 
2.76 
2.43 


2.69 
. 2.39 
2.36 
2.00 


♦Rating Scale: No impact ■ l t 
♦♦Difference between locations 


A. litte - 2, Soma ■ 3, 
for all groups: F=8.95, 


A great deal 
df=3/291 , if- 


1^4. 
< .001. 











Reported Impact by Average Hours of Project Effort Per Student Per Year Spent 
on Improving ^ttendance 

Projects reported spending varying numbers of hours per student per year on 
Improving student attendance. Table 11-2, shows the distribution of projects 
in the sample by hours of effort devoteo to improving attendance* 

• ' • \ / ■ ; ' . . 

- nm\& n-2 * 

HOURS OF PROJECT EFFORT/DE, VOTED TO STUDENT ATTENDANCE 



Hours Per Student / 
" Per Year / 


Number of Projects, 


o n ; : 

1-20 i 
21-40 
41-80 
81 or more 

Total 


41 

24 
12 
17 

... .7.1. ' 

> ^ 101 



Ratings by staff, teachers, and parents of the Impact of the projects on 
attendance were analyzed based on the amount of project effort devoted to.*r 
attendance. The results of those analyses are presented In Table 11-3. 



11-9 



TABLE 11-3 

MEAN RATINGS OF THE IMPACT ON ATTENDANCE 
BY HOURS OF PROJECT EFFORT* 
(N=101) 



Hours per Student- 
Per Year 




N 


Staff 
Mean 


Teachers 
Mean 


Parents 
Mean 


*" o** 
•1-20 
21-40 
41=80 
81 or more 




41 

24 
12 
17 

7 


. 2.92 
3.40 
3. IS 
3.24 
3.29 


2.69 
2.93 
2.88 
2. 95 
2.91 


2.32 
2.46 
2.12 / 
2.55/' 
3.0^ 


•Rating Scale: No Impact = 1, A 
**pifference between projects for 


little s 2, 
all groups:. 


Some = 
F=7. 1 1\ 


3, A great deal 
dt=4/285, p < 


J 4 
.05 



In general, the ratings given to projects which spent at least some hours on, 
improving attendance were higher than the ratings given to projects sbendlng 
no hours on improving attendance. The number of hours which were spertt per 
student per year, however, was not systematically related to impact ratings 
given by staff, teachers, and parents. 



It is an important finding that the 41 projects which did not formally bend 
efforforT improving attendance nevertheless we^e rated by teachers, staff, and 
parents as\having had a little to some, impact on Improving fattendance/of 
Indian students. Also, it is important that those projects which^formally 
made an effort to improve attendance were i*ated higher by teacbef s, ^itaff , and 
parents than projects which did not formally make an effort^ Improve 
attendance. J , . 

Relationship Between Reported Impact on Attendance^and .Attendance Trends 



In order to determine whether the reported 




laets on , attendance were rel ated 
to actual attendance trends, correlations/were computed between mean project 
Impact ratings by staff members, teachefsy and parents, %and Scores ^howirig , 
project-wide changes in attendance between 1977 and 1980. Separate change 
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scores were calculated for elementary 'school students* for secondary school 
students, and for an average of the two groups. 

The results of the analyses show no significant correlations between Impact 
ratings and changes in attendance- Although some positive correlations might 
have been expected* the failure to find such correlations was not surprising 
given that: " ,, ; 

• The range of mean project impact ratings was narrow* due to regression 
toward .the mean; 

'•-Even those projects where no effort was devoted, to attendance had moderate 
Impact ratings; and 

• The project change In attendance score was a relatively Insensitive 
measure, because changes In attendance would be expected for only a 
limited number of students (see Chapter 10). 

D„ Summary 

Title IV* Part A project staff* classroom teachers* and parents all reported 
th>t the^Part A projefcts had produced a positive Impact on stucient 
attendance* Project staff were most positive 1n their ratings (mean 3 3.14 on a 
scale from ; l m no impact* 2 * a little, 3 * some* and 4 =/a great deal)* ^ 
Teachers gave, somewhat lower ratings (mean^2 s S3)* and parents gave the lowest ; 
(mean^2.42). Ratings for all groups were highest for projects on or near v3 
reservations or in other rural areas* and Wire lowest for projects in ? ^ 

metropolitan areas. Ratings were higher for those projects which specif ically 
devoted hours to Improving attendance* but even the projects whitch dW not ^ 
formally devote project hours to improving attendance were rateti as having a 
little to some impact. The number 4 of hours devoted to Improving attendance ^ 
was not systematically related to ratings of impact. ; S 




CHAPTER 12; DROPOUT AND RETENTION IN PUBLIC SCHOOLS 

J 

T. LaFromboise and Blair Rudes 



, Introduction , 

- » 

Although a prime Jndlx/ator of successful educational programs is academic 
achievement, -another major Indicator is student matriculation or persistence. 
The process of defining dropout or attrition rates has been complicated by the 
inability of researchers to (3) agree upon behaviors that constitute an 
appropriate^jjef inition of dropout and (2) distinguish between individual * and 
institutional variables that contribute to the problem. A "dropout" may be 
defined as "any youth who for any reason, except death, has left school before 
graduating from high school without transferring to another school 11 (Cervantes 
1965). However, this definition fails to distinguish between two very 
different types of behavior — dismissal and Voluntary withdrawal (Tinto, 
1982). A voluntary decision not to, complete a given course of study is much 
different from falling to do sp because of ^personal and academic difficulties. 
Dismissal usually hinges upon displays of behavior Inappropriate to 
institutional standards (e.g., stealing", drinking, non-attendance, or poor 
performance). Voluntary withdrawal, on the other hand, is marked toy adherence 
to values incongruent with those that characterize the social and Intellectual 
climates of the school (Pascarella & Terenzlne, 1977). 

In order to fully understand the nature of the dropout problem among Indians, 
one needs to first look at the characteristics of dropouts and the factors 
which lead them to terminsfe the educational program short of graduation. 
Cervantes (1965) states that the "typical 11 dropout is more likely to be male 
than female, to live in the South, and to be a slum dweller. The lower the 
family 1 ! socioeconomic level, the greater a student 1 s chance of becoming a 
dropout (Beck & Muria, 1980). Bachman (1972) reports affective 
characteristics of the dropout to include low self-esteem, little desire f or | 
personal growth, and limited commitment to accepted social values. With 
respect to .health, the dropped 1 splays a greater -than-average ^number of s r V 
somatic symptoms, especial 1y auditory and dental disorders (Howard & AndeNohi 
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1978}, Also, the less cohesive the family* the less likely it Is that the 

stuSent will graduate* (Cervantes * 1965). 

% ■ ) 

The characteristics of Indian dropouts arl similar, There appears to be an 
equal prevalence among Indian males as females (Brown, 1973; Qviatt, 1973). 
The typical profile Includes the following variables: 17.5 years of age with 
6.4 siblings (one previously a dropout), single rather than married, between 
the tenth or eleventh, grade, arrested one or more times, and never contacted 
or helped by aT social service agency after leaving school (Davids, 1963; * 
Scott, 1967)* Ellas (1973) found that over one-half of Indians' who had 
dropped out demonstrated an Interest in returning to school. Those who did 
riturn displayed a greater concern for future plans than those who did not* 

Many of the reasons Indian, students leave school are similar' to those which 
have been noted for "non-Indians* However* attention must also be paid to 
certain culture-specific factors associated with Indian lifestyle arid . 
environment. According to Saasz (1974), Indian non-participation and failure 
within the educational system arise from. the system 4 s lack of relevance as 
perceived by American Indians", coupled with its failure to teal with Indian ■ 
cultural^ traditions and values. 

Traditionally, Indian education was practiced within^the extended family 
network. Many Indian families still operate on , the basis of a mutual sharing 
or reciprocal relationship wherein family needs take priority over /the demands 
of the larger, majority society. For Instance, Irregular attendance of Indian 
students may be due to such family responsibilities as in annual wild rice 
harvest. Rlclng and the associated festival activities in September typ tea 11 y 
involve entire families," including the children. Since urban school schedules 
do not take such activities Into consideration In setting up their calendars, 
Indian children returning to school 1n the fall may be a month late in 
entering the academic program (Dyslnger, 1975). Further, Hanks (1973) found 
that Indian "dropouts frequently cited their being needed at home^to care fpr 
younger siblings and elders while family members work at full, or part-time 
jobs as contributing to their decisions. 223 



Other fam11y*related factors influencing dropout include mobility and family 
cohesion, Many Indian families display a high rate of mobility in search of 
opportunities and jobs (Antell, 1979; Hopkins & Reedy, 1978) causing students 
to transfer between or within different types of schools; Wax and Wax (1964) 
found a higher frequency of dropouts among Indian high school students when 
the father was irregularly employed. Brown (1973) found that dropouts were 
characterized by factors indicative of Instability in basic family 
relationships. On a practical level, Indian students frequently observe 
little relationship between educational level achieved and jobs acquired by 
their parents and older siblings; due to limited job offerings, high school 
diplomas simply do not open doors on reservations (Kleinfleld, 1973), 

In addition to the^role which the family plays, the general, traditions and 
customs of the student's culture may Influence whether the student stays in . ^ 
school or drops out, Wh/ile this is particularly the case with Indians from 
rural /reservation areas, even. those^ living in urban areas, where the cultural 
expectations are not as great, report confusion about primary culture and 
dominant culture expectations. For example, the kind of individual competition 
typical of schools in foreign to some tribal groups, Also* Indian students 
brought up in the peer educational approach of most tribes find It difficult 
to adjust to the teacher-student learning style of schools, In some cases, 
students simplify matters by rejecting their heritage (Dyslnger, 1975), Once 
students have been thus alienated from their own culture as a result of 
culture conflict, they frequently display feelings of hopelessness and 
estrangement from thejr schools, home, and society In general (James, 1975)* 
Oviatt (1*973) found a limited future orientation, a negative self-concept, and 
little involvement of students or. parents in the educational system to bp 
variables differentiating Indian dropouts from Indian graduates, 

y - 

Like with their non-Indian counterparts, socioeconomic problems have much ±o 
do with the dropout rate, and Indian peoples have been shown to be the poorest 
of the poor (American Indian Policy Review Commission, 1976), McCarthy (1971) 
reports that Indian students, first realize their relative poverty upon 
attending school with non-Indians, Wax and Wax (1864) found a correlation of 
Indian dropout with extreme poverty, but none with personality, intelligence, 
and attitude toward school* Another study identified the two major factors 
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underlying majority student reasons for dropping out (Howard & Anderson, 1978) 
as family history and academic difficulties. The most Important aspect of 
family history is socioeconomic status (Bachman, 1972; Thompson & Nelson, 
1963). The probability of dropping out as a solution to personal and 
educational dissatisfaction is also maximized when the student has contact 
with family members and other persons who have dropped out" (II Hot, Voss & 
Wendling, 1966)* 

Academic predictors of dropout Include poor grades (especial ly in reading or. 
math), being held back (Bakal , Madaus & Winder, 1968; Coplein, 1962; Schuster, 
1971; Vogel , 1961), and difficulty retaining information (Brown & Peterson, 
1969), Strained student-teacher relationships and lower teacher expectations 
(Hecht, 1975) are also identified as contributing factors for both majority 
and Indian dropouts. Others school -related predictors Include irregular 
attendance, frequent tardiness, lack of participation in extracurricular 
activies, frequent change of schools, and an overall feeling of "not 
belonging" (Cervantes, 1965). ? Thus, the decision for students to drop out is 
a complex process encompassing a variety of factors. Conflict with 
institutional values of the schools, socioeconomic status, and parental 
concern for cultural education, in the Indian c<|se, are paramount. 

While many of the factors influencing Indian student dropout have been 
Identified, It far more difficult tq p 4 n down the actual number of -Indian 
students dropping out. In large part, this results from the unreliability of 
the previously available information on Indian dropout rate. Reports of „ 
Indian dropout rates and high school completion rates from the Current " - 
Population Surveys (CPS) conducted annually by the U.S. Bureau of Census do 
not permit reliable analysis of Indian attrition because of the sparse data 
available* on American Indians (Astin, 1982). The Digest of Educational * 
Statistics , for example, reports ethnic data collectively in terms of "Blacks 
and other races." The Condition of Education 1 only differentiates among 
Blacks, Hispanics and Whites. Even the most complete delineation of cultural 



*The Digest of Educational Statistics and the Condition of Education are annual 
reports published by 1 the Education Statistics of the U.S. 

Department of Education. : * \. 
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groups only presents American Indian dropout data from I960, 1970, and 1976 ' 
(U.S* Commission on Civil Rights, ^78), Furthermore, reliance on total 
Indian population figures is dangerous, since these fall to consider tribal 
and regional diversity, as well as variations among the types of schools that 
Indian students attend* As an example of the Importance of such factors^ 
Antell (1979) reported that Indian dropouts occu^ at a greater rate (30%) in 
public schools, where seventy percent of Indian children are educated, than in 
BIA schooTs (6*5%) or private schools (1*9%). . 

Special studies on Indian dropouts present an array of programmatic data 
regarding the effectiveness of specific educational programs in decreasing 
student attrition* Dropout rates contained In t|e studies are presented in 
Table 12-1 , and range from 14% to 60%, with 11,000 reservation children 
attending no school in 1976 (American Indian Policy Review Commission, 
1976b). ^ Bryde (1967), reported an Indian dropout rate of 60% In the middle 
of the 1960s. Although broader total U*S. population reports found the lower 
Indian dropout rates of 27% In I960, 16% in 1970, and iW In 1976 (U.S, 
Commission in Civil Rights, 1978) than did the special studies, this rate Is 
sttll substantially higher than that of the general population* Comparisons 
of Indian and total population dropout rates show a rate twice that of the 
general population in 1959 (Thompson & Nelson, 1963; Bryde, 1967), decreasing' 
in 1976 to a rate 10% over the general populati^T rate (IKS* Commission on 
:ivil Rights, 1978), 

In order to get a more systematic picture of the trends in Indian student 
dropout over the past decade, information on the subject was collected as part 
of Development Associates 1 evaluation of the Impact of the Part A Entitlement 
Program", Specifically, the academic and .occupational histories of a random 
sample of 2,098 Indians and Alaska Natives who were sophmores in high school 
' - . ■ A 



^These widely varying dropout rates may be due, 1n part, to different 
methodologies or definitions. For example, in its periodic population surveys 
the U.S. Census Bureau defines a dropout as a person between 16 and 19 who is 
not enrolled in school and who has not received a high school diploma* The 
Census Bureau also tends to underrepresent minorities* Se linger (1968), by 
contrast, followed a longitudinal sample of eighth graders as they progressed 
through or left school* I 
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TABLE 12-1 

DROPOUT RATES IN THE INDIAN AND GENERAL STUDENT 
POPULATIONS, AS REPORTED IN THE LITERATURE 



Survey 
Data 



1978 



Regional 



1165 
1969 
1976 

1974 
1978 
1978 

1981 



Sample 



Total BIA Schools 



Northwest 
"Southwest 
Northwest 

New Mexico 

Seattle 

Minneapolis 

(Junior High Students) 
New Mexico 



Indian Overal 1 
Dropout Dropout 
Rate Rate 



Author* 
Publication 
Date 





•I 


Percentages 


National 








1959 


National 


SIX 


22X 


1960 


Total BIA Schools 


60 


30 


1960* 


National 


27 


14 


1963 


Total BIA Schools 


60 


33 


1967 


National 


60 




1969 


. Total Indian Population 


40 


26 


1970* 


National 


16 


12 


V 

197S* 


National 




25 


1976* 


National 


IS 


5 



40 



50 




39 




48 




26 


25 


19 


10 


50 


6 


14 


9 



Coombs (1959) 
Thompson and Nelson 
(1963) 

U.S. Commission on 
Civil Rights (1978) 
Davids (1963) 
Bryde (1967) 
"Kennedy Repot 
(1969) 

U.S. Commisidn on 
Civil Rights (1978) 

-Grant (1975) 
U.S. Commission on 
Civil Rights (1978) 

. Hopkins and Reedy 

'(1978), 



\Selinger (1968) 

Bass (1969) 

U.S. Department of 
" Interior (1976) 

Horten (1974) 

Corwin (1978) 

Squires (1978) 
Young (1981) 



ERIC 



* Data acquired through U.S. Census procedures. These studies tend to under- 
represent Native American and non-Indian citizens. Therefore, it should not 



surprising that the data reflects a lower dropout rate. 



•Y 



233 



be 



12-7 



at the visited Part A project sites In this country during each of the 
academic years 1970-71, 1972-73, 1974-75, 1976-77, an1 1978-79 were reviewed. 
The objective was to determine If there wertf changes over time In the educa- 
tional patterns of Indian students 4 who attended schools receiving Title IV, 
Part A funds. 1 Subjects were almost equally divided by sex (M » 1004, F ..■ 
1063)* Most (39%) of the subjects lived on or near reservations, while others 
lived in other rural (28%), urban ( 19%), and metropolitan (14%) areras - Many 
(34%) attended schools with 5% or fewer Indian students; 24% of the subjects 
attended schools with a 5-21% Indian student population, 28% attended schools 
of 21*70% Indian enrollment, and 14% with Indian enrollment of 70-100%. 
Because recorded data on the ethnicity of students tends to be more 
consistently available toward the middle and later half of the 1970* s, and 
because the memories of -local personnel concerning of which students In past 
years were Indian were also better for later years, the total number of * 
potential subjects which could be identified Increased over the years 
(1970-71, 357; 1972-73, 371; 1974-75, 416; 1976-77, 453; 1978-79, 462), 

Of the subjects reviewed, 78% had graduated from high school, 3% had earned a 
GEO, 3% were still In high school at the time of the survey, and 16% had 
dropped out, A look at the 16% who had dropped out of high school uncovers 
some character istl cs of their educational experience, their current employment 
status, and their occupational choices, A grouping of the dropouts by 
sophomore year shows no significant change frwnl9?0 to 1979 (1970-71, 20%; 
1972-73, 14%; 1974-75, 17%; 1976-77, 17%; 1978-79, 15%), Distribution 
according to school location indicates that metropolitan schools have fewer 
dropouts and more graduates than rur al /urban/reservation schools (Table 
12*2), Most of the dropouts were currently unemployed (20%) or homemakers 
(33%); some were on active duty in the armed services (4%) or in full or 
part -tj me work (50%). Only 2% were engaged In either vocational technical or 
academic training (Table 12-3). ^ ___ 



3The 3% percent who earned a GEO may be considered to have Initially 'dropped 
out, and then returned to complete their studies. However, for the remainder of 
this chapter the more conservative of 1 dropouts ' (I.e.* excluding 

those who earned a GEO and Including only those who left school before * 
.graduation and did not subsequently ;congilete their studies) is used* 
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TABLE 12-2 

PERCENTAGE OF DROPOUTS AND GRADUATES BY PROJECT LOCATION 

(Weighted N=2131) \ 



Project Location 


N 


Dropouts 


• . Graduates 


/■ 

On or near reservation 
Other rural\ areas 
yrban areas 
Metropolitan 


960 

S4;> 

276 
402 


17% 
19 

22 
.12 


83% 
81 
78 
88 


•The actual number of ea&§sJ*eport 
table does not Include those stll 
after Initially leaving fehool. 


ing information 
1 in high school 


on this topic was 1881. The 
or receiving a GEO degree 

i • 



TABLE 12-3 



CURRENT EMPLOYMENT STATUS OF DROPOUTS* 
(Weighted N^244j 



Employment . Dropouts 

Full or part-time work " 50% 

Homemaker 33 

Unemployed - ^0 

Active duty In Armed Forces 4 

Vocational or technical training 2 

Two or four-year academic training 1 



*The actual number of cases reporting Information on this topic was 216* &4ta 
presented In this table wire weighted to make the proportion of studeafs \ 
supplying information approximately equal across the all Title IV, Part A 
projeetsv ftesponses tequal more than IpOX due to multiple responses, which ^ 
primarily from homemakers who are also employed. . ; " ; y 



These results confirm the findings of earl ler studies regarding the high virtc^g 
dence of Indian student dropout In public schools* and show that the trend has 
been for the dropout rate to remain relatively constant over the past decade. ; 
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8. The Involvement of Title IV, Part A Projects in Reducing Dropout 



As discussed earlier in this chapter, the factors which influence the 
decisions of Indian students to stay in school or to dropout are varied and 
complex* Many, such as family mobility and socioeconomic status, are outside 
the control of the educational system proper. However, others of these 
factors may be dealt with by educational programs and, Insofar as they relate 
to Indian students in particular, are appropriate concerns for Title I)f, Part 
A projects. For this reason, during Development Associates 1 evaluation of the 
impact of the Part A Program, information was collected on the extent and 
perceived Impact of Title IV, Part A^projects 1 Involvement in reducing 
dropouts among Indian students* When project directors of Title IV, Part A 
^projects at each of the 115 sites visited for the study were *sked to Identify 
the primary objectives of their projects, somewhat over half (58I-) indicated 
that reducing dropout was among them. On the other hand, when principals at 
schools served by thesfTltle IV, Pift A projects were asked to list what thfey 
considered to be the primary purposes of the local projects, only 20% listed 
"reducing student dropouts and increasing student retention*' 8 This discrepancy 
may in part be related to the fact that Title -IV, Part A projects, through 
their cultural and counseling activities, address many of the factors 
influencing dropout without having specific activities directed to the dropout 
issue. ' 

Information gathered from projtect staffs, teachers* and parent committee 
members at the 115 sites visited also indicates that Title IV, Part A projects 
* were perceived to be having a moderate impact on reducing dropout* Project 
% staff and non-staff teachers of regular school classrooms attended by Indian 
students, when asked to assess the Impact of the Indian educatton project on 
reducing dropouts* provided mean ratings of 3*26^* of 3*05, respectively, on 
an assumed interval scale fresh 1 (no impact) to 4^great deal of impact)* 
Similarly, Indian parent committee members, when asked to measure the success 
of the projects 1 cultural activities in preventing dropouts, provided mean 
ratings of 2*99 on an assumed Interval scale from 1 (not successful) to 4 
{'very successful)- * s 
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C. Summary and Conclusions 

Indian dropouts demonstrate many of the same characteristics and motives as 
their non-Indian counterparts. The situation ajpong Indian students is, 
however, complicated by culture-specific fapcSrs influencing the decision to 
dropout* As a result* the Indian sti^ent^ifropout rate, has consistently been 
shown to be higher than public school sttfdents overall. The data collected 
for this study on Indian student dropout # rom public schools over the past 
decade show that the dropout rate averaged 16% s *and was relatively consistent 
over those years. Thus, available evidence indicates that the level of _ 
Indians dropping jut of public schools is quite high, although there seems to 

have been some reduction during the 1960s and 1970s, 

i • 

When project staff, teachers, and parent committee members were asked ta rate 
the role which local Title IV, Part A projects had played In reducing 
dropouts, each group gave relatively positive ratings- However* the study's- 
data on the experiences of specific Indian students indicates that, 
- nationally, no substantial change has occurred in the number of Indian 
dropouts from public schools since Title IV began. Thus, the findings 
regarding the probable Influence of Title IV, l^rt A on Indian student 
dropouts are mixed.C The behavioral measures regarding a sample of Indian 
students ,suggest no change , while parents and school personnel report some * 
positive change as a result of the Program, In the chapter which follows we 
examine these findings in light of information presented elsewhere in this 
report in order to better determine what impact *T1tle IV, Part A projects may, 
have had on reducing Indian student dropout. 
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CHAPTER 13, SIJWARY AND CONCLUSIONS CONCERNING INDIAN STUDENT 
PUBLIC SCHOOL ATTENDANCE AND RETENTION/DROPOUT 

Blair Rudes 

A, Preface 

A wide range of findings concerning Indian student attendance and retention, 
and the role that Title IV, Part A projects have played In this area .has been 
presented* To facilitate an overview, they are summarized here. Addition- 
ally, the findings led to several conclusions, These are presented in the 
finaK section of this chapter, 

X 

% f « 

\ ■ 

B. Summary of Findings x 

On the basis of a comparison of Indlan\ student attendance rates with national 
% student attendance data* it appears that overall Indian student attendance is 
Nin the same range as that of the general population. Overall Indian 
attendance was relatively stable across the four study yeaJ^i, A breakdown of 
Indian student attendance data by geocultural region shot^Khat the highest 
attendance levels occur in the eastern states, ^n the Mid-South, in Alaska, 
and in Oklahoma, while the lowest levels are found in the Dakotas' and the 
western states, 

• . - - s ■ ' * - v: 

The average daily attendance of Indian students general fy increased at a 
decelerating rate from kindergarten through the fifth and sixth grades. From 
sixth grade to ninth grade, attendance remained relative stable^ at a high 
level, Between ninth and eleventh grades, there was a progressive loss of 
about three days per gr*ade level, ; 

^ ■ 

Analyzed in terms of location of school districts, the highest attendance 
levels occurred at rural, non-reservation sites, except In 1977, when 
metropolitan schools showed the highest levels, A breakdown^ the data by 
density (proportion of Indian students to the total student population of the 
school) revealed an Inverted bell -pattern, with Indian, student attendance N 
highest in schools with either the least or greatest densities of Indian 
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students* This same pattern was found when the data were analyzed in terms of 
size of school districts; that is, the smallest and the largest districts had 
the highest Indian student attendance levels. 

An examination of the attendance data in terms of student characteristics 
showed these to be nearly the same for male and female, the latter averaging 
less than one day better attendance each yiar, Indian students with a low SIS 
(as measured by the free lunch program) averaged below the attendance of other 
Indian students. 



In evaluating the role of Title IV, Part A projects in improving tfte attendance 
of Indian students, it was found that projects with very low and/or worsening 
attendance rates tended to devote more hours to improving attendance than did 
other projects. Furthermore, projects tended to expend a larger percentage of 
their efforts during school hours as the attendance problems increased. 

When the analysis focused on only those Indian students with low attendance 
(150 or fewer days) in 1979, it was- found that their "attendance had Improved 
an average-of over 15 days between 1979 and 1980* Moreover, the low attendance 
students who had gained IS or more days between 1979 and 1980 had been served 
by projects that expended more extensive efforts in 1981-82 - in terms of 
hours of service per year - on improving attendance. Rural, non-reservation 
projects were found to be the most effective In Improving the attendance of 
the low attending Indian students. 

Tjie analysis of parent, classroom teacher, and project staff ratings of Title 
IV, Part A project Impact on attendance revealed positive mean ratings for all" 
three groups, with the latter rating the impact of the project highest. Within 
all three groups, respondents from Metropolitan projects reported less impact 
than*those from other locations, and respondents from rural and reservation 
projects reported the greatest Impact. 



iteraturei review revealed that, notwithstanding a range in estimates of# 
14-6056, IndJan dropout rates were,* In each case, markedly higher than the 
overall dropojit rates cited. For Indian stuj^gt dropouts* like their 
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noo^Indian counterparts, socioeconomic problems have much to do with the 
dropout rate. Culture-specific factors associated with Indian lifestyle and 
environment, and the educational system's perceived lack of relevance or 
sensitivity to Indians, were also cited as factors. The Development 
Associates data, gathered from sites receiving Part A funds, affirmed this 
pattern, revealing further a sizable average dropout rate of 16%, which has 
remained relatively constant throughout the ten year period examined. 
Nevertheless, project staff, classroom teachers, and parent committee members 
at these sites gave general ly positive ratings concerning the effect of the 
local projects in reducing dropout. 



Conclusions , 

Several conclusions can be drawn from the information presented. First, it 
appears that the attendance problem is no greater among Indian students than 
among the general student population. Second, where Indian student attendance 
is below the mean attendance rate for all Indian students, Title IV, Part A 
projects are addressing the problem, with more' time spent during school hours 
as the problem Increases, Third, the data show that, at least for Indian 
students in the low attendance group, the Title IV, Part A projects which 
spend more effort on improving*- attendance may be having positive impacts, 

Regarding Indian student retention, no hard evidence was found to support a 
view that Title IV, Part A projects have had an impact^. While local 
perceptions of the role of Title IV, "Part A projects in reducing dropout were 
positive, the Indian student dropout rate remained relatively constant over 
the past ten, years, A somewhat similar pattern was founJ for attendance; that 
is, although local perceptions of project impact on improving attendance were 
positive, this was not reflected in substantial changes In the overall Indian 
student attendance rates. Specific analyses of the low attendance Indian 
students, however, demonstrated apparent improvements in attendance within 
this group as a result of thf projects, Thus, where small numbers of. Indian 
students have been retained as a result of Title IV, Part A project 
activities, the 1 ocal perceptions of project impact may be based on these 



cases, which r J not be sufficient to significantly Influence the national 
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trends. Also, local perceptions of dropout rata were collected for the last 
school year, but dropout data for the past three years is undetermined. 

In addition to examining the rate at which Indian students remained or dropped 
out, data were collected on post-secondary experiences, and on the aspirations 
held by students still In school. The findings are presented in the next 
section of this report," 
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PART C: PGST^SECONDARY KNOWLEDGE, ASPIRATIONS, AND IXPBUENCES 



r 



Guidance and career counseling activities are key components of many Title IV, 
Part A projects, A review of -needs assessjperits for Part A projects showed that 
guidance and career counseling was the third most frequently mentioned need 
(behind basic skills and cultural/historical components). Also, in three-quarters 
of projects where the need for career counseling was identified, the need was 
addressed through Part A objectives and activities. 

Even In projects which did not have formal career counsel ing components, there*^ 
was Ifkely to be some informal career counseling* An unstated objective of many, 
projects was to provide role models for Indian students, and most Part A staff 
members $ad had some form of post-secondary education, 

Data were therefore collected to assess the knowledge and aspirations of Indian 
students toward post-secondary education, and the actual experiences of Indian 
students after high school, Data on post-secondary knowledge and aspirations 
were collected from Indian secondary school students, and are presented in 
Chapter 14, Data on post-high school experiences of former Indian students were 
collected from various sources In the school and tJje community, and are presented 
In Chapter 15, 
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' CHAPTER 14: KNOWLEDGE AND ASPIRATIONS OF CURRENT PUBLIC HISH SCHOOL STUDENTS 
WITH RESPECT TO POST-Sf CONDARY ACADEMIC OPPORTUNITIES 

* ■ Paul Hop stock 

As part of Development Associates 1 spring 1982 data collection, Indian students 
In grades 10-12 were asked a series of questions about their knowledge of 
post-secpndary academic opportunities and whether they desired to obtain 
post-secondary schooling* A total of 2,860 Indian students in grades 10-12 
completed the student questionnaire, and approximately 95% of these completed the 
Items on post~secondary knowledge and aspirations. 

There were three main areas* of questions concerning post-secondary academic 
knowledge and aspirations. Students were,, asked whether: 

(1) Anyone in the school had talked to them about going to school after high 
school , and If anyone had encouraged them to go on to school; 

(2) They knew about colleges and vocational schools, scholarships for Indian 
students, and special school s^or programs for Indian students; and 

(3) They would like to continue their education after high school, and if so, 
whece. 

The results on these threejreas of questions are presented in separate sections 
below, 

A, Interactions With School Staff 

Students were first asked If anyone in the school had talked to them about 
colleges,* universities, or vocational/technical schools where they might go 
after finishing high school* Three-quarters (75%) of the students -reported 
that they had had such conversations* Table 14-1 shows the percentages of all 
responding students who reported conversations with various' types of school * 
officials. (Seeause students .could report conversations with more than one , 
type of school official, the percentages in Table 14-1 total more than 100%*) 

The data indicate that students are most likel y to talk_t^_gu1 dance counselors. 
- and teachers about post-secondary opportunities* Almost a quarter of the 
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TABLE 14-1 



PiRCENTASE Of STUDENTS REPORTING CONVERSATIONS WITH 
SCHOOL OFFICIALS ABOUT POST-SECONDARY EDUCATION 

(N-2^S9) 



Type of School Off ic ial 



Guidance counselors 
Teachers 

Indian education project staff 
Principals or assistant principals 
Others • 



Percentage of 
All Students 

52% 
36 
22 
9 
14 



responding students, however, Indicated' that they had had conversations about 
post-secondary opportunities with Indian Education project staff. 



In order to gain additional Information on the impact of the Title IV, Part A 
Program, students were divided (based on a series of screening questions) Into 
those who had definitely had contact with the Program, those who aright have - 
had contact with the Program, 1 and those with no contact with the Program 



during the 1981-82 school year* 


Table 


14-2 shows that students 


who had con* 


tact with Title IV f Part A were 


more likely to have discussed pc 


)st-secondary 


opportunities with school officials than those who had not had * 


such contact* 




TAB LI 


14-2 , 




C0NVBWATI0N5 ABOUT POST-SECONDARY SCHOOLS BASED- ON 
CONTACT WITH THE .PART A PROGRAM 








Contact with The «Part A Program 


Conversations About 
Post-Secondary Schools 




4 

Yes Perhaps 
(N«T?01 } (N-1024) 


NO 

(N*T33) 


Yes 
No 




79% 70% , 
21 30 


65% ?: : 
35 


, Total 




I00X 100% 


- ink- 


X2 * 30.13, df » 2, p < ,001, 


4 







1 These students' responses regarding program participation were ambiguous, 
suggesting that at most thai r ; contact - was ju^f|^itec 
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(Chi -square tests of statistical significance are used throughout this chapter 
to determine between-group differences,) 

Whether students had talked to someone In the school about post-secondary 1 ^ 
academic opportunities also was" related to certain student and project 
characteristics, Tenia le students were more likely to have had such 
conversations than male students, and students in higher grades were more 
likely to have had conversations than students in lower grades (se&- Table 
14-3). This latter finding was expected, since students In higher grades are 
closer to actually entering post-secondary institutions. Students who 
attended schools on or near reservations, in metropolitan areas (in or near 
cities of 50,000 or more), or in other urban areas (titles of 10,000-50*000) 
were more likely than students in non-reservation rural areas -to have 

discussed post-secondary opportunities with school officials (the percentages 

2 

of positive responses were 77%, 76%, 74%, and 70% respectively, with X = 
11.30, df ^ 3* p <,05). 

TABLE 14-3 

CONVERSATIONS ABOUT POST-SECONDARY OPPORTUNITIES BY GRADE AND SEX 



Conversations About 
Post*s4ftondary Schools 


Males 
Grade 
10 " 11 12 
(N^lSe) (N-IF6) (N^3~44) 


Females 
Grade 
10 .11 12 
fN^545)(N^IJl)(N^396) 




Yes 
No 


61% .72% 87% 
39 28 13 


68% 76% 92% 
32 24 8 


Total , 


. 100% 100% 100% 


100% 100% 100% 


X2 (Sex) ■ 11.36, df « 1, 


p< ,001 . yfi (Grade) - 


142.64, df = 2, p<.001 

€ 



Another question asked of students was whether anyone in the school had 
encouraged them to > go on to a college university, or vocational/technical 
school after graduating from^hlgh sfchool. Approximately 70% of Indian 
students responded that they had been so encouraged, When fihey were asked 
what kind of school had been recommended, 45% of all responding students said 
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that they had bean encouraged to attend a college or university* 16% said that 
vocational school, 5% said that no particular type of school had been 
mentioned, and If said they had been encouraged to attend some other kind of 
school, Exposure to the Title IV f Part A Program appears to have 'increased 
the likelihood that attendance at a post-secondary school was encouraged. As 
Table 14*4 Indicates, 10% more of those students who had contact with the 
Program than those who did not have contact were encouraged to attend a 
post^secondary school* 

TABLE 14-4 

ENCOURAGEMENT OF POST-SECONDARY EDUCATION 8Y LEVEL OF 
. ' CONTACT WITH THE PART A PROGRAM 



Encouragement of 
Post-Secondary Education 




Contact With The Part-A Program 

Yes Perhaps No 
(N?f?44) TN-d74) (N=T23)^ 


Yes 
No 




72* 
28 


66% 62% 
34 38 . 


Total 




100% 


100% 100% 


X 2 m 15.44, df ■ 2, p < .001, 

* 5 



The extent to which students reported that they had been encouraged to attend 
post-secondary school Was also strongly -elated to the grade and sex of the 
student. Females wepe more likely than males to report that they had Been 
encouraged, and students In higher grades were more likely to report such, 
encouragement than students in lower grades (see Table 14-5), Perhaps not 
surprisingly, males were more likely than females to be encouraged" to attend 
vocational schools (21* versus 12% of all students), while females were more^ 
. likely than males to be encouraged to attend colleges or universities (52% 
versus 37%), 
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TABLE 14-5 

, ENCOURAGEMENT OF POST-SECONDARY EDUCATION BY GRADE AND SEX 





Males 


Females 




Encouragement for 


Grade 


Grade 




Post-Secondary Schools 


JO J_L 12^ 


JO JJL 


J2 




, (N=453)(N=438)(N=336) 


(N^n9)(N»514)(N^381) 


Yes 


58% 63k 77% 


67% 71% 


87% 


No 


42 3^_ 23 


"33 29 


13 


Total 


100% 100* 100% 


100% Tob% 


100% 


X 2 (Sex) = 22.08, df = 1 


, p <.001 ' X 2 (Grade) * 


78. 28, df = 2, 


i 

p <.001^ 


Knowledge of Post-Secondary Opportunities 







The second area of questions which was aslced of Indian students concerned 
their knowledge of post*$econdary academic opportunities* In particular, they 
were asked If they knew: * * 

i 1 

1) Where to go 1f they wanted to find out more Information abotit universities, 
colleges, or vocational/technical schools; 

2) Any grants or scholarships- that give Indian students money to go to a 
college or university; 

3) Where to go If they wanted to learn mora about grants or scholarships for 
Indian students; , 

4) Any collegejs, universities, or vocational /technical schools In the United 
•States that are mostly for Indian students; and 

5) Any colleges or universities In* the United States that have programs 
specifically for Indian students. 
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In all five questions, students were asked to name a specific source of 
information, grant, or post-secondary school . The number of Indian students 
who indicated that they had knowledge in each -of the five areas Is illustrated 
In Table 14-6. Students reported having knowledge in an average of U 9 of the 
five areas. 



TAB LI 14-6 



KNOWLEDGE OF POST-SECONDARY OPPORTUNITIES 
i (N^2743) 



Area of Knowledge 



Percentage of Students 




67% 

32 
39 
33 
20 



/ 



Whether or not students had had contact with the Title IV, Part A project B^ad 
a significaat impact on knowledge of post-secondary opportunities, Table 14-7 
shpws that for each of the five knowledge areas, students who had contact •with 
the Title IV, Part A project were more likely to have knowledge than students 
without contact. 
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TABLE 14-7 



KNOWLEDGE OF POST-SECONDARY OPPORTUNITIES BY LEVEL OF 
CONTACT WITH THE PART A PROGRAM 
(Percentage of students Indicating .knowledge) . 



Area of Knov ledge 



Where to go for Information on schools 
Grants or scholarships for Indian students 
Where to go for Information on grants 0 
Schools that are mostly for Indian students^ 
Schools with special programs for Indian students 1 



Contact With The 
Title IV-A Program - 
Yes Perhaps No 
(N^15a3)(N^101S)(N^131) 



7CW 


64* 


57% 


36 


27 


31 


44 


33 


27 


37 


26 


32 


24 


14 


18 



/ 

Mean number of areas Indicated 



* x 2 
« X 2 



17.94, df 
41.22, df 
35,41, df 



2, p .001 
2, p . .001 
2, p .001 



b X 2 ^ 21.84,' df 
d 'X Z - 40.9?, df 




There were also a number df student amkproject characterises ( which were 
related to the extent ^fcnow ledge of p«±-$econdary opportuiiities. Students 
in fisher gradls had Considerably more knowledge than did students 1n lower 
grades, and females had* more knowledge than males* ^ Table 14-8 shows the mean 
number of are^Labout which students reported they had know/ledge f by 'grade and 



TABLE 14-8 

KNOWLEDGE OF POST -SECONDARY OPPORTUNITIES BY GRADE ANO SEX 
{Mean number of areas reported) 



Sex 


Gj 

JO 


JX 


12 




(^1028) 


(N«979_») 


(N=739) . 


Male . 


1.4 


1.7 


2.4 


Female 




1-9 


2,7 










F (Sax) - 16,64, df ~ 1/2740, p < .001 








F (Grade)* 117.46, df = 2/2740, p < S QQ1 j 

* 


1 







! 



In 'terms of project characteristics, the data Indicate that stMQdents attending ' 
schools on or near reservations had more knowledge of academic oppportunlties 
than did students in other geographic settings- Students in scfenools on or 
near reservations reported knowledge in an a^f^e of 2*1 of th^^ five areas, 
while students in other settings reported knowledge In an ayergsrae of 1.7 of 
the areas (F = 12.00, df - 3/2742, p < ,001)* students on or n»ar reservations 
were more likely td report knowledge on availUjIHty of scholarships* the 
presence of special schools for Indians, and t lie 'presence of sp^scial programs 
for % Indians.^ There were no significant differences in terms of knowledge - 
concerning phere .to go to 1 earn -mire; about pas-Meeondary schog^pfs or where to 
go to learri more about scholarships. ^^^^ 

There Was a difference in level of knowJedge of post-secondary ^opportunities 
based on the presence or absence of a counsel ing component in tdne Title IV, 
Part A project* Students in projects with a counseling componenwt (59 



14-9 ; > 

projects) reported knowledge In an average of 2,0 of th# five areas f while 
students ih .projects without a counseling component (55 projects) reported 
knowledge in aa average of 1.8 areas (F = 12.30, df = 1/2733,' p < O01). The 
differences between groups were significant In the areas of where to go for 
Information on grants, schools that are mostly for Indian students* and schools 
with special programs for Indian students. There were no s ijni^ant 
differences in the areas of where to go for information on post-secondary 

schools* and grants or scholarships for Indian students* - • 

*i .•• . * 

C. Aspirations For Post-Secondary Education % 

The third area asked of Indian students concerned their aspirations, for 
post-secondary education. Students were asked if they would like to continue 
their education after high school, and, specifically, if theywouli like to 
attend a vocational/technical school ^pd/or^a college or university m Nine out 
of_ ten (90%) Indian students reported that they had post --secondary academic 
aspirations, with 32% of those specifying that they would like to' axtend a 
vocational/technical school, and 53% specifying that they would like to attend 
a college or university- \ 

Aspirations for post-secondary education were more likely among those students 
with contact with the Title IV, Part A project than among students without 
contact* As Table 14-9 indicates, students wjih contact with the Title IV, 
Part A project were more likely to deslre^W go to a colle9e or university, 
but were not more likely to desire to go to a vocat i ona 1 /iecbnical school, 
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" TABLE 14-9 



■ASPIRATIONS FOR POST-SECONDARY EDUCATION BY LEVEL OF 
CONTACT WITH THE PART A PRo) 



(Percentage of students) 




y 



\ 


Contact With The 






Title IV-A Program 


Aspirations for attending* , , 


Yes * Perhaps 


• "No 




(N=1580) (N=10O2) 


(N*128) 


Some for-r^n of post-secondary school a 


92% 89%, 


87% 


A vocational /technical school ^ 


.31 - 36 


30 


A collegge or university c 


56 49 


52 


- n-g^-a ■ »- - 

* X 2 - 7 67, d.f - 2, p < .05 c 


------- - i 

1 X 2 '= 8,04, df = 2, p < .05 




c X 2 = 1S.97 S df « 2, p < ,001 







Post*stc^»ndary aspirations also depended upon, certain student character- 
istics* As Table 14*10 shows f females were more likely than males to want to 
go to a raeollege or university. While males were more likely to want to go on 
to a vocational/technical school- Aspirations for vocatlonaT/technical 
training also increased from grade 10 to grade 12 f while aspirations for 
attend inCT a college or university decreased. These changes may indicate that 
there is an increasing vocational orientation as students approach graduation* 
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■ # , . TABLE 14-10 

ASPIRATIONS FOR POST-SECONDARY gDUCATION BY GRADE AND SEX 
(Percentage of students) 



Males Females 
Grade Grade 

Aspirations for attending, , , 10 11 J2 JO U J2 

Y * 1_ "__„_. ( N-770) (ICT47) (N^37)(N^720) (N^?93) 

Some form of post-secondary school 3 87« 87% 92% 92X 94 92 

A, vocational/technical school b 36 39 42 22 30 31 

A .college or university 0 51 44 45 61 57. 58 



a x2 (Sex) ^21.06, df ■ 1, p<-001 X§ (Grade) = 0,99, df ^ 2, n,s. 

b X§ (Sex) - 28.41, df - 1, p<.Q01 xf (Grade) - 14,79, df f 2, p<,001 

c t d (Sex) - 66-95, df « 1, *p< . 001 X" (Grade - 6.32, df ^ 2, p<,05 



The otner student characteristic which was related to post-secondary 
aspirations was achievement on standardized tests, Table 14-11 summarizes 
the mean standardized (X - 50, S,D, * 10) reading and mathematics scores of 
Indian students who did and did not have aspirations for post-secondary 
education, The results indicate that students who had aspirations for college 
had higher reading and mathematics scores than students without college 
aspirations, but that there were no significant differences in test scores 
between those who, aspired to vocational/technical schools and those who did 
not. 



ZAchlevement test scores from the 1980-81 school year were available for 1,418 
tenth to twelfth grade students who completed the questions on post-secondary 
knowledge and aspirations -In 1982* See Chapter 4 for a discussion of the 
procedures used 1n obtaining and analyzing these test score data* 
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TABLE 14-11 



MEAN STANDARDIZED READ INS AND MATHEMATICS SCORES 
BY TYPE OF POST-SECONDARY ASPIRATIONS 



Aspirations attend _._ , , 

Some form of post-secondary se iool 
Yes 
No 

A vocational/technical s choo T " 

Yes 
^ No 
A college or university 

Yes 

No 



Mean Reading 
Score 


Mean Math 

Score 


(N-/05) 


(N-713) 


47.6 


48.21 


45. 0 


44.8 


46.1 


47.1 


48.2 


48.6 


49. l2 


49.73 * 


44.9 


45.6 



a F = 4,00, df ■- 1, p < ,05 
C F = 5,56, df • 1, p < ,05 



b F » 5,30, df - 1, p < .05 



Post-secondary aspirations, also related to certain project characteristics, * 
As Table 14-12 shows, students in projects on or near reservations or in other 
rural areas were more likely to desire to attend vocational/technic*! schools, 
while students in projects in metropolitan areas were more likely to desire to 
attend a college, or university* 



TABLE 14-12 



j 



POST -SECONDARY ASPIRATIONS OF STUDENTS BY PROJECT LOCATION 
(Percentage of students) • 



Aspiration to attend. . . 


Geographic Location 
On or Near Other Rural Urban 
a Reservation , Area Area 


MetropoJ 1 tan 
Area • 


Some form of post-secondary 

SChQO.1 a - 


(N*1435) 

92% 


(N^654) 

87% 


(N=29l) 

86% 


(N=330) 

92% 


A vocational/technical 
school b 


36 


32 


26 


24 


A college or university 0 
i 


53 


52 


47 


64 • 


a x| = 24.26, df ■ 3, p < .001 
c X 2 ,» 18.93, df '■ 3, p <. .001 


b X 2 = 


25.62, df 


- 3, p < 


.001 " . 
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Summary 

A majority of Indian students have talked to sch&ol officials about 
post-secondary academic opportunities, have bp^n encouraged to attend 
post^seeondary school, and Would like to attend such a school, Indian 
students also have moderate levels of knowledge concerning post-secondary 
opportunities. The Title IV, Part A/Program appears to be a stimulus to 
post-secondary education, Studen^^who had contact with the Program in the 
1981-82 school year reported mare knowledge of post-secondary opportunities, 
and Indicated higher levels^df post-secondary academic aspirations, Indian 
females were more likely/than Indian males to want to go to college, while the 
latter were more likeiy to want to go to vocational/technical school- The 
location of the school was also related to students 1 knowledge of 
post-secondary opportunities and aspirations for post-secondary study. The 
relationships between student post-secondary knowledge and aspirations and a 
number qf other variables (educational level of the project director, perceived 
success of a counseling component, etc) were also examined, but the results 
failed ^to provide unambiguous explanations of the basic findings. 
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CHAPTER 15: TRENDS IN , POST-HIGH SCHOOL ACTIVITIES OF INDIAN STUDENTS 
Paul Hopstock and Teresa La Fromboise 

As a part of the fall data collection in Development Associates' evaluation of 
the Title IV, Part A Program, information was collected concerning the academic 
and vocational experiences of past Indian students! A sample of Indian students 
who had been sophomores in high school in the school years 1970-71* 1972-73, 
1974-75* 1976-77, and 1978-79 was selected, and data collectors sought ou*i 
persons (principals, counselors, parents, etc. ) who had knowledge of tnose past 
students. Knowledgeable persons were asked to describe the experiences of the 
former students in terms of high school completion, other education experiences, 
present working s tatus, and vocational category. The results on high school 
completion have been presented previously in Chapter 12. Results concerning 
academic and vocational experiences are presented in this chapter, 

- 

Data were collected concerning a total of 2,098 students. Because the selection 
procedure was such that different proportions of students were, selected at 
different sites, the data were subsequently weighted so that the final analysis 
sample included 2,438 cases. The data on those 2,438 cases are presented below* 

A, Educational Experiences 

As described in Chapter 12* of those Indian students In the sample who had 
stayed in school until tenth grade, 78% had graduated from high schools an 
additional 3% had passed a high school equivalency test such as a GED, and 3% 
were still in high school* This means that the dropout rate was 16% for those 
students In the sample* 

For those former students who had graduated from high school or passed a high 
school equivalency test, respondents were asked to describe their highest 
level of educational attainment* The overall results on this question are 
presented in Table 15-1. These data indicate that the majority of Indian high 
school graduates had gone pn to some form of post-secondary school, with 23% 
having attended a vocational, trade, or business school, and 34% having 
attended college, . . " - • — 
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TAR! ^ 1^-1 




HIGHEST EDUCATIONAL LEVEL OF INDIAN 

V™ «00**J 


HIQH SCHOOL GRADUATES . • 


Highest Educational Level 


Percentages of 
Former Student 


High school only 

Les# than two years of vocational school 

■ WO or miui C jftSsrs yi YU^dU lUila 1 9GJ1QQ I 

Some coMege (Including two-year degree) 
Completed colleoe (four or five vear dearer) 
Master's or doctoral degree 


43% 

.16 ' 
* 7 * 
28 


Total " 


JOGS 



There are significant differences In the highest educational level attained 
for the different high school cbhort groups. As Table 15-2 shows, those in 
the later cohort groups were less likely to have finished college than those 
In earlier cohort groups* In many cases,, this Is likely to be true because 
the students are still in college and have not yet completed their degrees, 



TABU 15-2 

HIGHEST EDUCATION LEVEL OF INDIAN HIGH SCHOOL ®A0UATES 
BY SCHOOL COHORT GROUP 



Highest Educational Level 



High school only 

Less than. two years of vocational 

school ^ 
Two. or more years of vocational 



Some college (including two year 
degree) 

Completed college (four or five year 
degree) 

Master's or doctoral degree 



TofTT 



43% 


41% 


47% 


42% 


16 


16 


16 


18 


8 


8 


11 


6 


25 


2* 


20 


30. 


a 

1 


10 
1 


5 
1 


A 
0 


100% 


1001 


100% 


100% 



Sophomores In ! ! 

1970-71 1972-73 1974*75 1976-77 1978-79 
(N*281) (N-290) (N»322) (N-364 



(N«362) 
40% 

15 

4 

40 



2 
0 



TOOT 



m 

■n 



X2«77.97, df»24, p 4,001 



2 
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If all students who have any college experience are placed in the same cate- 
gory, the 1978-79 cohort group had more students attending college than 
average s and the 1974-75 cohort group had fewer college students than 
average. There were also sex differences in educational level, As Table 15-3 
shows, Indian females were more likely to attend and complete college than 
were males, while Indian males were more likely to end their education with 
high school . 

* 

TABLE 15-3 

HIGHEST EDUCATIONAL LEVEL OF INDIAN HIGH SCHOOL GRADUATES 

' — - BY SEX 

(Percentage of students) 



Highest Educational Level 


Males 
(N=853) 


Females 
(N=//l) 




High school only ^^S^ 
Less than two years of vocational school 
Two or more years of vocational school 
Some college (including two year degree) 
Completed college (four or five year degree) 
Master's or doctoral degree* 


48% 
15 
8 

25 , 
4 
0 


" 39% 
17 
7 
31 
6 
0 


Total 


100% 


100% 


X2^16.88 f df=6, p <*01 

*For both males and females, the percentage attaining 


advanced degrees was 0,2%. 



The highest educational level of the high school graduates also depended upon 
the location of the^ school which they attended. As. Table 15-4 illustrates, 
the college completion rates of those on or near reservations and in urban 
areas (cities of 10,000-50,00) were lower than for those in rural or 
metropolitan (in or near a city of 50,000 or more) areas. 



TABLE 15-4 



HIGHEST EDUCATIONAL LEVEL OF INDIAN HIGH SCHOOL GRADUATES 

BY SCHOOL LOCATION 
(Percentage of total) 





School 


Location 




- - — . — — - -; On or Near 

Highest Educational Level Reservation 


Other 
Rural 


Urban 


Metropolitan 






(N=42S) 


(N=!91) 


(n=j1o) 


High school only 


43 


41 


44 


43 


Less than two years of vocational 










school 


17 


13 


18 


18 


Two or more years of vocationa.l 










school 


7 


8 


5 


6 


Some college (including two year 










degree) 


29 


29 


27 


26 


Completed college (four or five 










year degree) 


- 3 


9 


3 * 


7 


Master's or doctoral degree 


0 


0 


2 


0 


Total 


100% 


1001 


100X 


100% 


X2=35.06, df-18 s p<.0.1 



B. Present Vocational /Educational Status 
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Respondents were asked .to describe what the former student was doing 'at the 

* 1 
•time of the Interview, In most cases only one response to this question 

was given, but in 9% of the cases, at least two responses were given. Table 

15-5 shows the overall percentage of former students who were reported to be 

'engaged In each type qf activity* 



1 In. only 79% of all cases was the respondent able to describe the present f 
status of the selected students* An analysis of the valid and missing casts 
Indicated that high school dropouts were slightly underrepresented on thisv 
question* The response biases were small enough, however, that we believe thai 
the response distributions were not seriously affected, "' ."" 
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TABLE 15-5 

PRESENT STATUS OF FORMER STUDENTS 
(N*1825) 



Percentage of 

Statu s Former Students* 



Working for pay at a full -time or part-time job 57X 
Taking vocational or technical courses at 

any kind of school-or college ^6 

Taking academic courses at a college 15 

On active duty in the Armed Forces * * 4 

Homemaker 18 
Laid off, looking for work, waiting to report 

to work 9 



♦Percentage totals to more than 10(fe because in some cases more than one 
response was given. 



There were considerable differences in present status for the different school 
cohort groups. As shown in Table 15-6, those' in later cohort groups were more 
likely to be attending vocational school, attending college, or on active duty 
in the Armed Services, while those In earlier cohort groups were more-likely 
to be homemakers or to be working for pay. These findings are not at all 
surprising given, the expected ages of the cohort groups. 

Present status was also strongly related to the sex of the former student. 
Indian males were more likely than Indian females to be working for pay 
full-time or part-time* on active duty with the Armed Forces, or Tald off, 
looking for work, or waiting to report to work, Indian females, on the other 

hand, were more likely to be homemakers or to be taking academic courses at a 

i 

college (see Table 15-7) - ^ 
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- TABLE 15-6 

PRESENT STATUS OF FORMER STUDENTS BY SCHOOL COHORT «OUP 



Status 


1970-71 


Soph 
1972-73 
(N=324) 


omores 

1574-75 

(N=356) 


in . . .* 
1976-77 
(N=39d) 


197! -79 
(N=383) 


Working for pay at a tu I l-time 












or part-time job 


em 


69% 


61% 


SIX 


40% 


Talcing vocational or technical 












courses at any kind of school 










12 


or college 


3 


3 


2 


7 


T * cademic courses at a 












,ege 


4 


6 


10 


16 


36 


On active duty in the Armed Forces 2 


3 


5 


8 


_ 5 


Hot.iemaker 


24 


20 


21 


16 


10 


LHd off, looking for work, 












waiting to report for work 


10 


6 


11 


11 

f 


6 


♦Percentages may total to more 
response/was given. 


than 100% 


because in 


some cases more 


than one 



TABLE 15-7 

PRESENT STATUS OF FORMER STUDENTS BY SEX 
(Percentage of total}* 



Males 


Females 


(N=901) 


(N^dl) 


62% 


47% 


5 


5 


12 


16 


8 


1 


1 


32 


11 


6 



.Status 

Working for pay at a full-time or part-time jobb 
Taking vocational or technical courses 

at any kind of school or college 
Taking academic courses at a college^ 
On active duty in the Armed Forces 3 
Hememaker®, 

Laid off, looking for work, Waiting to 
- report - to work ■ 



^Percentages do not necessarily add to TOW because of rounding error and 
because more than one response was sometimes given. 



b x2*34.78, df^U p<,001 
dx2M2-0S f df^U p<**001 
f xZ*9.47, df»1, p< ,01 



GX 2 ^6*83| df=U P< .01 
ex 2 =269.17, df*l § p< .001 
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The location of the school which the former student attended was also related, 
to present status. The pattern of the data is rather complex, but as Table 
15-8 illustrates, those who attended school on or near reservations or in 
cities of 10/000-50,000 were more likely to be either employed for pay or 
serving as a homemaker, while those In other rural areas or In metropolitan 
areas ( 50, 000 or more) were more likely to be taking academic courses, 



TABLE 15*8 

PRESENT STATUS OF FORMER STUDENTS BY SCHOOL LOCATION 
(Percentage of total«) a 







*hool Location 






On or Near 


Other 






Status 


Reservation 


Rural 


Urban 


Metropolitan , 






(N=505) 






Working for pay at a full-or 








60% 


part-time jobb 


SIX 


59% 


50% 


Taking vocational or technical 










courses at any kind of school 








8 


or college c 


6 


3- 


4 


Taking academic courses at a 






10 


15 


college^ 


13 


18 


On active duty In the Armed Forces 


5 


4 


3 


4 


Homemaker^ 


17 


14 , 


25 


IS 


Laid off, looking for work, waiting 






9 


8 


to report for work 


10 


6 


^Percentages may total to more than 


100% because 


in some 


cases more tnan one 


response was given. 










bX 2 -13.90, df^3 f p ^,01 


cx2=g.79» df=3, 


p< .05 




dx2=8,S6, df=3, p< ,05 


6x2-14,91 s df^3 3 


, P< -01 





C- Occupational Categories 



For those former students who were employed full-time or part-time, 
respondents were asked to describe the type of work In which the former 
student was engaged* In this Item, as with the previous one, respondents were 
allowed to give more than one response,- though in only IX of cases did they- do 
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Table 15*9 presents the occupational distribution for the overall population 
arid for males and females separately* As might be expected, males were more 
likely to be employed in occupational categories such as craftsman* laborer, 
military, and operator, while females were more likely to be employed in - 
clerical, service, and homemaker positions. 



* . TABLE 15-9 

OCCUPATIONAL DISTRIBUTION OVERALL AND BY SEX 
(Percentage of total)* 



Occupation 


Overall 


Males 


Females 




(N=1348) 


(N=610 


) (N=716) 


Clerical 


17% 


4% 


28% 


Craftsman 


7 


IS 


1 


Fanner or farm manager 


1 


1 


0 


Homemaker or housewife 


18 


0 


34 


Laborer 


18 


35 


4 


Manager or administrator 


2 


3 


- I 


Military 


6 


11 




Machine or vehicle operator 


7 


10 


4 


Professional 


5 


3 


6 


Proprietor or owner 


1 


2 


0 


Protect lye service 


2 


3 


1 


Sales 


4 


2 


s 


Service 


10 


7 


12 


Technical * 


' 2 


3 


1 


Other 


1 


2 


' 0 


♦Percentages may total to more than 


100% because in. some 


cases 


more than one 


response was given. 









There were also occupational differences based on the school cohort group to^ 
which the former student belonged, As shown in Table 15-10, those In earlier 
cohort groups were more likely to be employed ^as craftsmen, professionals* 
managers t and homemakers, while those In later cohort groups were more likely 
to be employed as laborers, service workers, sales people, or by the 1 
military* These occupational differences for the school cohort groups | 
probably reflect age differences In employment patterns rather than long-term ^| 
career differences, * 
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TABLE 15-10 

OCCUPATIONAL DISTRIBUTION §Y SCHOOL COHORT GROUP 
(Percentage of total)* 



Occupation 



Clerical 
Craftsman 

Farmer or farm manager 
Homimaker or housewife 
Laborer 

Manager or administrator 
Military 

Machl ne or vehicle operator 

Professional 

Propretor or owner 

Protective service 

Sales 

Service 

Technical 

Other 





Sophomores in , , , 






1970-71 


1972-73 


1974-7S 


1976-77 


1978-79 


(N=2/8) 


(N-2S4J 


(N-281) 


{H=t8<Z) 


(fj-190; 


20% 


14% 


19% 


12% 


" 15% 


6 


13 


6 


7 


' 4 


2 


1 


0 


0 


0 


20 


19 


19 


18" 


14 


16 


16 * 


18 


20 


21 


3 


4 


3 


1 


1 


2 


3 


6 


10 


10 


S 


8 


9 


7 


8 


9 


7 


5 


1 


3 


3 


0 


"1 


0 


0 


2 


2 


1 


3 


1 


3 


3 


Jl 


6 


5 


8 


8 


8 


11 


17 


3 


2 


2 


2 


2 


1 


0 


2 


2 


0 



♦Percentages may total to more than 100% because In some cases more than one 
response was given. 



0, Summary 



ERIC 



The data on post-high school activities of Indian students indicate that 
approximately 40% of those who were in school up to the tenth grade went on to 
some form of post-secondary education* The data are not representative of the 
entire Indian population, however, because a number of Indian students drop 
out before they reach the tenth grade; Indian females were more likely to go 
on to college than Were Indian males, who were more likely to finish their 
education vrith high school. At the time of the study, 57% of the former 
students were members of the paid civilian workforce, 6% were taking 
vocational or technical courses',. 15% ftere taking academic courses, and 9% were 
laid off or looking for work. Among those who were employed, the most common 
occupational* categories were laborers (18<) f Wnemakers (18%), clerical 
personnel (17%), and service workers (10%). 
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